-- Logs begin at Thu 2022-06-16 16:29:56 UTC, end at Thu 2022-06-16 17:42:23 UTC. -- Jun 16 17:13:48.833593 dv-cinder-837356-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 17:13:48.843266 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 17:13:48.845280 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 17:13:48 2022] *** Jun 16 17:13:48.845280 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 17:13:48.845280 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 17:13:48.845280 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: nodename: dv-cinder-837356-2-iscsi Jun 16 17:13:48.845280 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: machine: x86_64 Jun 16 17:13:48.845280 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: clock source: unix Jun 16 17:13:48.845280 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: pcre jit disabled Jun 16 17:13:48.845280 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: detected number of CPU cores: 4 Jun 16 17:13:48.845280 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: current working directory: / Jun 16 17:13:48.845280 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: detected binary path: /usr/bin/uwsgi-core Jun 16 17:13:48.845280 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: your processes number limit is 47680 Jun 16 17:13:48.845280 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: your memory page size is 4096 bytes Jun 16 17:13:48.845280 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: detected max file descriptor number: 2048 Jun 16 17:13:48.845280 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: lock engine: pthread robust mutexes Jun 16 17:13:48.846255 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: thunder lock: enabled Jun 16 17:13:48.846255 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 17:13:48.846255 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 17:13:48.888383 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: Python main interpreter initialized at 0x5614ff1909c0 Jun 16 17:13:48.888383 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: python threads support enabled Jun 16 17:13:48.888383 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: your server socket listen backlog is limited to 100 connections Jun 16 17:13:48.888383 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: your mercy for graceful operations on workers is 90 seconds Jun 16 17:13:48.888741 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 17:13:48.888741 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: *** Operational MODE: preforking *** Jun 16 17:13:48.889036 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: *** uWSGI is running in multiple interpreter mode *** Jun 16 17:13:48.889036 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: spawned uWSGI master process (pid: 103175) Jun 16 17:13:48.889264 dv-cinder-837356-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 17:13:48.889939 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: spawned uWSGI worker 1 (pid: 103176, cores: 1) Jun 16 17:13:48.893045 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: spawned uWSGI worker 2 (pid: 103177, cores: 1) Jun 16 17:13:48.893045 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 17:13:49.534468 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 17:13:49.535098 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 17:13:50.694984 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:13:50.694984 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: from cryptography.utils import int_from_bytes Jun 16 17:13:50.695589 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:13:50.695589 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: from cryptography.utils import int_from_bytes Jun 16 17:13:50.729318 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:13:50.729318 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: from cryptography.utils import int_from_bytes Jun 16 17:13:50.729859 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:13:50.729859 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: from cryptography.utils import int_from_bytes Jun 16 17:13:53.241342 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:13:53.242128 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:13:53.242128 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:13:53.242452 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:13:53.242712 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:13:53.243090 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.243412 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.243726 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.244034 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.244363 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.244668 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.244981 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.245328 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.245637 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.245894 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.246208 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.246527 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837356-2-iscsi {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.246848 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.247151 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.247465 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.247779 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.248081 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.248402 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.248690 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.249494 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.249943 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.250250 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.250360 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:13:53.250725 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.250803 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:13:53.250877 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.251109 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:13:53.251220 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.251473 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:13:53.251654 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.251809 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:13:53.251938 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.252088 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.252249 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.252413 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.252536 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.252687 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.252815 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.253035 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.253159 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837356-2-iscsi {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.253392 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.253514 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.253669 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.253793 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.253986 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.254134 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.254306 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.254471 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.254651 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.254785 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.254936 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.255057 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.255200 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.255322 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.255559 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837356-2-iscsi {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.255663 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.255823 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.255952 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.256130 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.256226 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.256443 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.256538 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.256760 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.256894 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.257055 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.257221 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.257396 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.257533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.257704 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.257847 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.258022 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.258209 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.258350 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.258512 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.258653 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.258790 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.258914 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.259099 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.259231 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.259432 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.259571 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.259743 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.259875 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.260050 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.260189 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.260366 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.260505 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.260632 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.260754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.260883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.261048 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.261258 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.261391 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.261515 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.261680 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837356-2-iscsi {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.261819 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.261993 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.262129 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.262302 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.262429 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.262611 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.262738 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.262940 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.263067 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.263248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.263378 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.263553 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.263680 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.263858 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.264000 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.264225 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.264692 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.264841 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.264973 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.265088 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.265236 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.265361 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.265554 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.265778 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.265950 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.266088 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.266224 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.266360 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.266571 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.266698 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.266828 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.266952 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.267116 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.267249 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.267423 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.267558 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.267767 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.267898 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.268060 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.268193 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.268329 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.268452 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.268606 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.268747 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.268929 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.269090 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.269274 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.269403 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.269598 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.269727 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.269849 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.269982 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.270105 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.270236 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.270394 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.270521 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.270700 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.270834 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.271012 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.271139 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.271315 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.271447 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.271616 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.271743 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.271917 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.272050 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.272211 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.272337 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.272512 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.272640 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.272812 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.272939 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.273114 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.273309 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.273448 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.273573 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.273728 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.273880 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.274030 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.274157 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.274333 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.274467 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.274633 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.274761 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.274932 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.275065 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.275245 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.275379 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.275561 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.275689 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.275896 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.276036 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.276170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.276300 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.276430 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.276567 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.276726 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.276862 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.277041 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.277193 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.277385 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.277511 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.277694 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.277841 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.278007 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.278141 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.278309 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.278433 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.278610 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.278755 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.278924 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.279051 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.279181 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.279303 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.279453 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.279588 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.279756 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.279891 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.280095 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.280232 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.280526 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.280848 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.280982 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.281156 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.281337 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.281485 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.281621 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.281786 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.281905 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.282084 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.282217 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.282387 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.282522 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.282688 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.282815 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.282988 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.283130 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.283289 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.283424 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.283584 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.283710 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.283888 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.284014 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.284193 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.284331 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.284497 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.284630 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.284799 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.284923 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.285102 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.285259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.285444 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.285571 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.285746 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.285891 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.286088 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.286217 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.286349 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.286472 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.286650 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.286776 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.286954 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.287081 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.287257 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.287383 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.287575 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.287701 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.287881 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.288008 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.288184 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.288324 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.288501 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.288628 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.288809 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.288936 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.289113 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.289299 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.289455 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.289590 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.289756 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.289883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.290061 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.290188 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.290377 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.290518 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.290683 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.290808 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.290986 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.291112 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.291287 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.291421 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.291588 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.291714 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.291889 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.292008 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.292193 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.292331 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.292494 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.292621 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.292795 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.292927 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.293093 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.293322 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.293449 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.293574 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.293737 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.293871 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.294043 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.294170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.294348 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.294474 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.294651 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.294776 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.294968 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:13:53.295107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.295281 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.295417 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.295628 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.295803 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.296254 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.296513 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.296802 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.296939 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.297163 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.297425 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.297577 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.297829 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.298013 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.298141 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.298364 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.298498 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.298684 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.298821 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.299003 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.299129 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.299319 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.299446 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.299659 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.299785 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.299975 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.300100 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.300290 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.300423 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.300606 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.300742 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.300921 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.301047 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.301258 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.301400 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.301570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.301702 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.301880 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.302013 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.302183 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.302317 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.302487 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.302613 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.302791 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.302929 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.303099 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.303238 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.303404 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.303531 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.303720 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.303853 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.304043 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.304172 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.304349 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.304481 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.304681 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.304815 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.304986 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.305123 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.305319 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.305441 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.305630 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.305755 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.305939 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.306065 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.306246 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.306367 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.306558 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.306660 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.306868 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.306965 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.307172 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.307268 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.307479 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.307588 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.307789 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.307893 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.308089 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.308182 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.308396 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.308500 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.308701 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.308795 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.309006 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.309101 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.309354 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.309461 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.309662 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.309763 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.309974 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.310069 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.310282 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.310385 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.310589 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.310683 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.310895 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.310989 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.311200 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.311324 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.311765 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.312043 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.312365 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.312494 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.312686 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.312812 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.312999 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.313126 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.313352 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.313480 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.313684 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.313817 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.313995 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.314122 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.314300 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.314434 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.314614 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.314741 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.314920 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.315056 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.315226 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.315361 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.315535 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.315670 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.315840 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.315973 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.316143 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.316277 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.316477 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.316604 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.316726 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.316849 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.317025 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.317273 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.317408 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.317546 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.317671 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.317802 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.317968 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.318107 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.318272 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.318400 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.318577 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.318702 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.318880 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.319006 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.319193 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.319329 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.319503 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.319630 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.319817 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.319944 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.320129 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.320255 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.320449 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.320583 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.320765 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.320894 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.321077 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.321222 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.321414 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.321552 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.321727 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.321863 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.322038 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.322165 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.322350 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.322486 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.322660 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.322787 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.322977 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.323104 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.323279 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.323412 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.323589 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.323715 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.323892 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.324019 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.324194 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.324331 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.324496 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.324622 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.324805 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.324938 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.325106 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.325297 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.325423 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.325555 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.325724 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.325863 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.326028 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.326164 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.326334 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.326475 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.326661 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.326787 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.327119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.327251 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.327565 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.327876 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.328016 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.328188 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.328328 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.328498 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.328624 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.328810 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.328937 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.329131 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.329292 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.329512 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.329637 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.329843 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.329975 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.330152 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.330294 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.330475 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.330601 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.330785 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.330911 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.331102 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.331234 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.331404 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.331528 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.331714 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.331838 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.332028 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.332163 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.332342 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.332469 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.332660 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.332784 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.332970 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.333095 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.333315 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.333457 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.333628 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.334056 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.334248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.334385 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.334560 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.334686 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.334865 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.335000 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.335170 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.335295 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.335478 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.335617 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.335783 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.335908 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.336088 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.336215 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.336398 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.336524 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.336705 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.336830 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.337019 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.337125 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.337352 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.337449 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.337667 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.337770 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.337965 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.338071 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.338269 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.338356 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.338581 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.338684 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.338890 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.338976 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.339202 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.339297 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.339520 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.339607 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.339828 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.339921 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.340129 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.340214 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.340447 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.340533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.340755 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.340849 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.341056 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.341141 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.341398 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.341487 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.341699 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.341792 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.342057 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.342151 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.342353 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.342441 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.342723 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.343043 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.343179 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.343362 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.343529 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.343657 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.343852 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.343969 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.344172 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.344269 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.344491 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.344578 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.344803 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.344890 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.345113 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.345236 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.345457 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.345551 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.345777 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.345879 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.346098 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.346204 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.346406 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.346492 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.346717 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.346803 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.347036 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.347127 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.347347 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.347435 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.347655 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.347740 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.347980 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.348064 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.348264 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.348349 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.348575 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.348661 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.348890 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.348976 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.349242 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.349501 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.349588 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.349840 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.350016 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.350158 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.350245 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.350475 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.350561 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.350784 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.350878 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.351088 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.351175 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.351393 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.351479 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.351696 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.351784 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.352039 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.352139 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.352346 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.352440 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.352648 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.352753 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.352952 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.353044 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.353281 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.353370 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.353593 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.353693 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.353897 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.353985 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.354200 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.354287 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.354503 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.354598 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.354812 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.354900 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.355117 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.355203 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.355420 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.355515 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.355722 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.355809 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.356025 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.356132 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.356341 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.356439 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.356641 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.356728 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.356949 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.357036 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.357282 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.357386 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.357595 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.357682 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.357902 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.357986 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.358287 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.358673 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.358761 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.358976 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.359158 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.359319 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.359508 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.359626 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.359963 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.360097 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.360293 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.360447 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.360635 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.360776 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.360941 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.361104 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.361265 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.361462 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.361592 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.361789 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.361896 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.362128 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.362215 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.362462 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.362549 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.362778 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.362864 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.363086 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.363186 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.363384 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.363480 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.363692 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.363779 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.363999 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.364085 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.364308 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.364412 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.364613 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.364711 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.364912 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.364997 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.365232 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.365322 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.365533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.365633 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.365836 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.365922 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.366139 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.366227 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.366440 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.366537 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.366739 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.366825 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.367048 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.367135 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.367347 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.367432 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.367644 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.367728 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.367945 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.368043 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.368243 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.368332 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.368554 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.368653 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.368856 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.368949 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.369154 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.369268 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.369478 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.369572 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.369784 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.369871 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.370091 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.370178 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.370391 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.370485 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.370710 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.370804 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.371019 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.371112 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.371320 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.371487 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.371621 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.371715 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.371927 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.372013 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.372236 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.372333 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.372522 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.372606 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.372818 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.372904 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.373122 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.373233 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.373450 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.373548 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.373794 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.373941 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.374101 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.374190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.374404 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.374545 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.374707 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.374865 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.375010 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.375173 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.375316 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.375473 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.375617 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.375777 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.375918 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.376076 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.376219 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.376388 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.376537 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.376697 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.376816 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.376997 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.377104 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.377321 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.377468 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.377625 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.377771 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.377927 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.378073 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.378224 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.378372 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.378528 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.378709 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.378829 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.379010 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.379139 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.379373 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.379481 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.379670 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.379757 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.379979 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.380075 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.380281 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.380368 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.380582 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.380669 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.380879 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.380965 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.381215 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.381318 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.381511 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.381599 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.381807 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.381892 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.382106 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.382194 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.382406 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.382494 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.382703 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.382800 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.382999 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.383087 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.383305 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.383391 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.383620 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.383713 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.383927 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.384013 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.384226 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.384320 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.384529 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.384634 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.384825 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.384911 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.385123 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.385240 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.385461 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.385563 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.385766 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.385862 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.386063 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.386151 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.386361 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.386450 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.386658 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.386769 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.386954 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.387048 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.387249 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.387345 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.387562 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.387648 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.387865 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.387951 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.388162 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.388249 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.388457 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.388547 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.388755 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.388880 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.389088 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.389240 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.389440 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.389527 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.389768 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.389865 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.390080 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.390168 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.390386 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.390480 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.390695 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.390791 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.391001 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.391088 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.391304 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.391398 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.391605 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.391699 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.391903 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.392035 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.392213 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.392351 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.392518 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.392661 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.392825 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.392969 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.393124 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.393377 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.393474 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.393749 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.393856 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.394057 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.394178 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.394363 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.394494 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.394677 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.394801 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.394994 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.395217 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.395306 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.395532 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.395620 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.395844 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.395931 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.396155 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.396241 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.396462 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.396550 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.396763 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.396856 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.397067 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.397154 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.397395 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.397492 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.397701 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.397787 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.398004 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.398097 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.398308 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.398404 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.398610 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.398704 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.398917 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.399013 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.399220 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.399315 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.399524 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.399639 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.399822 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.399984 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.400139 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.400227 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.400448 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.400642 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.400739 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.400953 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.401049 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.401289 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.401380 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.401613 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.401712 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.401926 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.402011 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.402246 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.402352 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.402551 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.402646 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.402863 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.402958 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.403176 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.403263 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.403500 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.403602 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.403823 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.403918 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.404131 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.404223 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.404440 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.404535 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.404741 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.404828 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.405130 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.405307 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.405580 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.405668 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.405899 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.405993 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.406204 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.406288 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.406505 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.406628 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.406807 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.406957 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.407112 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.407269 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.407430 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.407594 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.407729 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.407918 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.408026 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.408225 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.408313 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.408528 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.408629 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.408841 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.408929 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.409144 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.409281 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.409479 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.409654 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.409803 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.409962 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.410108 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.410266 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.410431 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.410673 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.410774 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.410981 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.411069 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.411285 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.411385 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.411587 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.411674 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.411907 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.411992 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.412206 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.412300 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.412512 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.412605 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.412818 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.412900 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.413123 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.413241 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.413466 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.413554 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.413771 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.413858 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.414075 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.414161 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.414385 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.414471 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.414683 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.414776 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.414983 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.415070 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.415287 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.415380 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.415595 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.415680 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.415910 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.415998 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.416228 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.416314 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.416562 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.416649 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.416892 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.416980 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.417225 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.417317 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.417546 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.417644 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.417848 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.417936 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.418147 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.418234 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.418452 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.418547 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.418753 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.418836 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.419057 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.419143 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.419357 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.419460 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.419657 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.419744 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.419955 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.420046 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.420254 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.420342 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.420551 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.420825 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.420948 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.421035 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.421272 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.421476 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.421564 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.421799 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.421886 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.422100 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.422206 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.422419 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.422514 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.422729 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.422828 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.423268 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.423370 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.423370 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.423505 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.423635 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.423723 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.423932 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.424026 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.424239 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.424331 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.424534 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.424622 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.424830 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.424918 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.425127 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.425263 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.425486 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.425590 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.425786 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.425874 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.426098 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.426186 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.426425 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.426512 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.426744 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.426841 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.427048 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.427133 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.427360 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.427454 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.427672 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.427768 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.427981 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.428067 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.428292 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.428387 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.428601 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.428688 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.428896 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.428981 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.429217 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.429320 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.429525 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.429612 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.429824 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.429914 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.430122 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.430349 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.430465 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.430679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.430767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.430993 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.431080 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.431292 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.431388 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.431585 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.431672 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.431900 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.432001 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.432197 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.432285 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.432507 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.432594 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.432811 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.432909 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.433109 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.433211 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.433432 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.433519 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.433727 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.433827 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.434064 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.434151 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.434359 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.434445 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.434686 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.434773 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.434999 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.435085 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.435307 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.435393 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.435623 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.435726 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.435926 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.436017 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.436324 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.436425 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.436647 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.436952 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.437039 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.437284 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.437385 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.437599 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.437688 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.437910 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.437996 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.438219 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.438307 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.438528 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.438617 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.438837 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.438924 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.439146 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.439233 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.439455 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.439559 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.439762 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.439857 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.440071 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.440171 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.440383 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.440596 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.440691 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.440921 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.441016 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.441253 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.441344 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.441562 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.441654 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.441874 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.441962 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.442183 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.442271 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.442488 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.442738 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.442825 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.443053 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.443141 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.443373 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.443460 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.443678 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.443776 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.444003 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.444098 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.444317 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.444405 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.444630 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.444718 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.444955 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.445044 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.445280 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.445371 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.445583 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.445671 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.445888 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.445976 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.446191 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.446277 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.446501 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.446598 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.446820 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.446909 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.447119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.447212 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.447421 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.447516 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.447727 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.447814 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.448030 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.448116 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.448334 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.448560 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.448648 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.448904 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.448992 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.449242 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.449349 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.449556 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.449642 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.449862 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.449958 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.450170 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.450267 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.450471 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.450557 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.450788 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.450933 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.451090 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.451190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.451392 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.451481 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.451702 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.451789 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.452037 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.452174 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.452339 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.452501 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.452639 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.452948 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.453045 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.453282 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.453373 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.453586 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.453674 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.453895 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.453996 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.454196 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.454284 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.454523 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.454609 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.454826 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.454916 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.455127 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.455214 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.455431 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.455518 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.455730 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.455824 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.456029 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.456117 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.456329 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.456414 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.456629 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.456717 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.456929 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.457015 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.457259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.457350 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.457559 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.457700 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.457864 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.457951 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.458165 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.458252 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.458471 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.458994 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.459086 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.459337 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.459425 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.459654 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.459743 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.459975 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.460063 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.460297 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.460384 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.460600 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.460694 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.460898 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.460984 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.461232 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.461321 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.461534 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.461622 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.461834 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.461921 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.462142 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.462238 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.462448 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.462536 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.462746 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.462833 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.463043 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.463301 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.463390 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.463634 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.463720 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.463932 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.464020 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.464238 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.464334 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.464533 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.464621 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.464852 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.464940 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.465152 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.465324 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.465474 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.465571 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.465773 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.465880 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.466077 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.466172 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.466377 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.466465 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.466676 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.466772 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.466975 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.467063 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.467274 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.467361 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.467687 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.467859 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.467986 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.468076 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.468290 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.468379 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.468586 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.468759 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.468890 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.468980 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.469218 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.469350 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.469519 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.469637 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.469827 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.469949 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.470142 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.470257 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.470455 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.470570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.470753 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.470876 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.471062 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.471177 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.471367 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.471483 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.471687 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.471801 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.471991 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.472111 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.472298 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.472412 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.472605 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.472726 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.472914 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.473038 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.473249 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.473541 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.473665 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.473801 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.473917 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.474115 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.474231 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.474442 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.474565 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.474766 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.474859 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.475070 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.475159 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.475369 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.475477 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.475665 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.475787 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.475983 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.476109 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.476288 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.476434 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.476594 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.476745 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.476900 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.477049 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.477224 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.477383 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.477529 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.477714 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.477832 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.478052 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.478140 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.478381 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.478478 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.478705 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.478792 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.479002 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.479089 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.479306 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.479402 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.479607 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.479739 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.479911 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.480038 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.480208 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.480312 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.480518 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.480617 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.480818 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.480907 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.481118 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.481241 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.481461 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.481550 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.481761 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.481847 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.482064 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.482165 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.482364 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.482452 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.482663 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.482749 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.482965 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.483059 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.483297 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.483421 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.483592 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.483712 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.483892 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.484083 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.484180 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.484385 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.484474 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.484765 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.484852 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.485070 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.485157 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.485395 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.485524 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.485698 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.485822 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.485997 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.486119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.486296 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.486418 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.486602 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.486717 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.486923 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.487043 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.487215 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.487341 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.487522 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.487644 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.487844 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.487959 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.488156 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.488282 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.488478 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.488592 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.488786 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.488899 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.489083 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.489240 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.489415 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.489530 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.490256 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.490346 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.490437 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.490528 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.490611 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.490691 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.490771 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.490865 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.490948 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.491028 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.491159 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.491249 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.491506 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.491616 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.491754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.491843 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.492047 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.492135 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.492341 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.492437 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.492635 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.492731 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.492934 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.493021 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.493249 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.493355 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.493549 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.493662 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.493845 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.493982 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.494139 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.494298 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.494434 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.494606 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.494728 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.494932 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.495031 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.495241 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.495330 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.495551 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.495639 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.495865 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.495961 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.496158 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.496243 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.496451 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.496538 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.496776 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.496865 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.497094 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.497207 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.497439 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.497540 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.497753 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.497840 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.498059 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.498156 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.498372 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.498460 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.498675 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.498805 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.499089 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.499185 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.499407 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.499501 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.499712 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.499799 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.500015 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.500104 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.500341 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.500438 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.500646 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.500735 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.500950 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.501047 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.501207 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:13:53.501316 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.501573 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.501877 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.502181 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.502502 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.502821 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.503120 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.503438 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.503750 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.504060 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.504371 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.504675 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.504996 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.505336 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.505639 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.505946 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.506247 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.506551 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.506858 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.507167 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.507484 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.507803 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.508107 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.508424 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.508741 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.509080 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.509417 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.509754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.510073 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.510381 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.510685 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.510981 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:13:53.511219 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:13:53.562893 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO dbcounter [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] Registered counter for database nova_api Jun 16 17:13:53.572201 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO dbcounter [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] Registered counter for database nova_api Jun 16 17:13:53.584704 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_db.sqlalchemy.engines [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:13:53.591957 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG oslo_db.sqlalchemy.engines [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:13:53.592368 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writer thread running {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:13:53.598644 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writer thread running {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:13:53.649505 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.context [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bda7c23a-ff4f-46ad-9b00-aa25962dbf72(cell1) {{(pid=103176) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 17:13:53.653616 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:13:53.654330 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.context [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bda7c23a-ff4f-46ad-9b00-aa25962dbf72(cell1) {{(pid=103177) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 17:13:53.655257 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:13:53.656054 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:13:53.658044 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:13:53.658599 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:13:53.660014 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO dbcounter [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] Registered counter for database nova_cell0 Jun 16 17:13:53.660147 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:13:53.660926 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:13:53.662889 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:13:53.663919 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO dbcounter [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] Registered counter for database nova_cell1 Jun 16 17:13:53.664859 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO dbcounter [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] Registered counter for database nova_cell0 Jun 16 17:13:53.668587 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO dbcounter [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] Registered counter for database nova_cell1 Jun 16 17:13:53.671552 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_db.sqlalchemy.engines [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:13:53.673548 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_db.sqlalchemy.engines [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:13:53.675949 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG oslo_db.sqlalchemy.engines [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:13:53.679633 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG oslo_db.sqlalchemy.engines [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:13:53.679976 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writer thread running {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:13:53.681273 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writer thread running {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:13:53.683829 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writer thread running {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:13:53.686579 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writer thread running {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:13:53.825922 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO dbcounter [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] Registered counter for database nova_cell0 Jun 16 17:13:53.830958 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO dbcounter [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] Registered counter for database nova_cell0 Jun 16 17:13:53.833116 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_db.sqlalchemy.engines [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:13:53.838735 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writer thread running {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:13:53.840430 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG oslo_db.sqlalchemy.engines [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:13:53.845303 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writer thread running {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:13:54.170954 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: WARNING keystonemiddleware.auth_token [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:13:54.171465 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: WARNING keystonemiddleware.auth_token [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:13:54.178274 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: WARNING keystonemiddleware.auth_token [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:13:54.178705 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: WARNING keystonemiddleware.auth_token [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:13:54.518679 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: WARNING keystonemiddleware.auth_token [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:13:54.519265 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: WARNING keystonemiddleware.auth_token [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:13:54.524625 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: WARNING keystonemiddleware.auth_token [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:13:54.525230 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: WARNING keystonemiddleware.auth_token [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:13:54.529880 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5614ff1909c0 pid: 103177 (default app) Jun 16 17:13:54.530522 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5614ff1909c0 pid: 103176 (default app) Jun 16 17:13:54.532060 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:13:54.533277 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-583c3148-ac9d-4f53-8b17-9fcfc95d1668 None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001756 Jun 16 17:13:54.533673 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 788 bytes} [Thu Jun 16 17:13:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:15:10.817005 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:15:10.818904 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002666 Jun 16 17:15:10.819292 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 1/2] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jun 16 17:15:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:15:10.830916 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_api:SELECT=3 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:15:10.832055 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_cell0:SELECT=3 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:15:10.832880 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_cell1:SELECT=3 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:15:10.834300 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:15:11.267315 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-a1740918-a75a-4b39-a91e-3274890d35f4 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:15:11.297134 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-a1740918-a75a-4b39-a91e-3274890d35f4 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.471871 Jun 16 17:15:11.297961 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 2/3] 10.222.0.66 () {60 vars in 1291 bytes} [Thu Jun 16 17:15:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:15:13.456766 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:15:13.457819 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-6c42e9cb-1223-4032-ac3b-67fafd8694f4 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jun 16 17:15:13.458843 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 2/4] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jun 16 17:15:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:15:13.531633 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-5a75881c-1008-4256-82dc-3cb45c28fa1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "ram": 256, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:13.550409 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:15:13.550409 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: warnings.warn(msg) Jun 16 17:15:13.579516 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-5a75881c-1008-4256-82dc-3cb45c28fa1b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.114254 Jun 16 17:15:13.580169 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 3/5] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jun 16 17:15:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:15:13.593813 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writing DB stats nova_api:SELECT=3 {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:15:13.595171 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writing DB stats nova_cell0:SELECT=3 {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:15:13.595915 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writing DB stats nova_cell1:SELECT=3 {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:15:13.596889 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:15:13.826286 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-96cc0800-1da1-47ec-8d05-389e1417238f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:13.829263 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:15:13.829263 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: warnings.warn(msg) Jun 16 17:15:13.935035 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-96cc0800-1da1-47ec-8d05-389e1417238f admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.346360 Jun 16 17:15:13.936101 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 3/6] 10.222.0.66 () {64 vars in 1335 bytes} [Thu Jun 16 17:15:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:15:16.131934 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-5a75881c-1008-4256-82dc-3cb45c28fa1b admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:15:16.132889 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-5a75881c-1008-4256-82dc-3cb45c28fa1b admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 16 17:15:16.147751 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 4/7] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jun 16 17:15:16 2022] GET /compute/v2.1 => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:15:16.274174 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-7088fd6c-697e-4307-97ed-83444795b79d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "name": "ds512M", "disk": 5, "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:16.292360 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:15:16.292360 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: warnings.warn(msg) Jun 16 17:15:16.311611 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-7088fd6c-697e-4307-97ed-83444795b79d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.162153 Jun 16 17:15:16.312192 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 4/8] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jun 16 17:15:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:15:16.324162 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-12e11f0f-199e-4790-a351-abe5ad4dfe70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:16.325999 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:15:16.325999 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: warnings.warn(msg) Jun 16 17:15:16.357458 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-12e11f0f-199e-4790-a351-abe5ad4dfe70 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036973 Jun 16 17:15:16.369256 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 5/9] 10.222.0.66 () {64 vars in 1335 bytes} [Thu Jun 16 17:15:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:15:18.499858 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-7088fd6c-697e-4307-97ed-83444795b79d admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:15:18.500907 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-7088fd6c-697e-4307-97ed-83444795b79d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jun 16 17:15:18.501465 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 5/10] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jun 16 17:15:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:15:18.564984 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-6aeacc40-933a-4635-8640-263801c60bf2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:18.583278 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-6aeacc40-933a-4635-8640-263801c60bf2 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075895 Jun 16 17:15:18.584341 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 6/11] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jun 16 17:15:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:15:18.596323 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-cff4a9c3-08d8-47ce-bc35-a4e18e023336 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:18.621085 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-cff4a9c3-08d8-47ce-bc35-a4e18e023336 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028569 Jun 16 17:15:18.621742 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 6/12] 10.222.0.66 () {64 vars in 1335 bytes} [Thu Jun 16 17:15:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:15:20.822871 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-6aeacc40-933a-4635-8640-263801c60bf2 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:15:20.823905 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-6aeacc40-933a-4635-8640-263801c60bf2 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 16 17:15:20.824317 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 7/13] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jun 16 17:15:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:15:20.903161 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-464d3935-beb1-42d8-bdc6-494820851352 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds2G", "disk": 10, "ram": 2048, "id": "d3", "swap": 0}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:20.923348 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-464d3935-beb1-42d8-bdc6-494820851352 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.088710 Jun 16 17:15:20.924027 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 7/14] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jun 16 17:15:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:15:20.936510 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-8f61a9ad-18a4-493e-b7fc-07efbcc5ba65 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:20.963714 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-8f61a9ad-18a4-493e-b7fc-07efbcc5ba65 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031202 Jun 16 17:15:20.964425 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 8/15] 10.222.0.66 () {64 vars in 1335 bytes} [Thu Jun 16 17:15:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:15:23.147114 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-464d3935-beb1-42d8-bdc6-494820851352 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:15:23.148126 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-464d3935-beb1-42d8-bdc6-494820851352 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 16 17:15:23.148758 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 8/16] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jun 16 17:15:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:15:23.208930 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-a90f27b5-4134-416c-828d-d7007a69742a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "id": "d4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:23.228645 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-a90f27b5-4134-416c-828d-d7007a69742a admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074095 Jun 16 17:15:23.229827 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 9/17] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jun 16 17:15:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:15:23.241512 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-10878917-119a-452b-829c-54b76336b1f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:23.270073 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-10878917-119a-452b-829c-54b76336b1f7 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032136 Jun 16 17:15:23.273740 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 9/18] 10.222.0.66 () {64 vars in 1335 bytes} [Thu Jun 16 17:15:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:15:25.578674 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-a90f27b5-4134-416c-828d-d7007a69742a admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:15:25.579688 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-a90f27b5-4134-416c-828d-d7007a69742a admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 16 17:15:25.580388 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 10/19] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jun 16 17:15:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:15:25.649955 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-b32fd666-79de-48b1-a464-d2743963ea31 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:15:25.674464 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-b32fd666-79de-48b1-a464-d2743963ea31 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086742 Jun 16 17:15:25.675027 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 10/20] 10.222.0.66 () {60 vars in 1291 bytes} [Thu Jun 16 17:15:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:15:27.879494 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-a90f27b5-4134-416c-828d-d7007a69742a admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:15:27.880585 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-a90f27b5-4134-416c-828d-d7007a69742a admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jun 16 17:15:27.881011 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 11/21] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jun 16 17:15:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:15:27.944634 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-f3328f9b-a0d0-4b1e-b9c0-2c1024619340 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "disk": 1, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:27.967743 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-f3328f9b-a0d0-4b1e-b9c0-2c1024619340 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080333 Jun 16 17:15:27.968388 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 11/22] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jun 16 17:15:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:15:27.980382 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-cd3ffc26-213f-43b3-975e-4d9e9e390226 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:28.006170 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-cd3ffc26-213f-43b3-975e-4d9e9e390226 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029395 Jun 16 17:15:28.007129 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 12/23] 10.222.0.66 () {64 vars in 1332 bytes} [Thu Jun 16 17:15:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:15:30.181673 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-f3328f9b-a0d0-4b1e-b9c0-2c1024619340 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:15:30.182685 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-f3328f9b-a0d0-4b1e-b9c0-2c1024619340 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jun 16 17:15:30.183090 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 12/24] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jun 16 17:15:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:15:30.254835 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-6f3f3f99-4238-4fb3-932b-59afcfc2332d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:30.277697 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-6f3f3f99-4238-4fb3-932b-59afcfc2332d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.088011 Jun 16 17:15:30.278492 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 13/25] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jun 16 17:15:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:15:30.294823 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-380e7649-8fe4-41dd-a5e2-a6d1341156bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:30.324781 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-380e7649-8fe4-41dd-a5e2-a6d1341156bd admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035808 Jun 16 17:15:30.340581 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 13/26] 10.222.0.66 () {64 vars in 1332 bytes} [Thu Jun 16 17:15:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:15:32.519218 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-6f3f3f99-4238-4fb3-932b-59afcfc2332d admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:15:32.520248 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-6f3f3f99-4238-4fb3-932b-59afcfc2332d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 16 17:15:32.520665 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 14/27] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jun 16 17:15:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:15:32.594541 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-9ffe504e-037f-4205-bb98-d451f84f1404 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "ram": 4096, "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:32.625750 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-9ffe504e-037f-4205-bb98-d451f84f1404 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.097924 Jun 16 17:15:32.626753 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 14/28] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jun 16 17:15:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:15:32.644900 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-06b8ca1b-c04c-491b-918a-f9022c3ba202 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:32.671711 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-06b8ca1b-c04c-491b-918a-f9022c3ba202 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030659 Jun 16 17:15:32.672356 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 15/29] 10.222.0.66 () {64 vars in 1332 bytes} [Thu Jun 16 17:15:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:15:34.793237 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-9ffe504e-037f-4205-bb98-d451f84f1404 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:15:34.794358 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-9ffe504e-037f-4205-bb98-d451f84f1404 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Jun 16 17:15:34.794858 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 15/30] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jun 16 17:15:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:15:34.855666 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-2ba4de76-1407-4e02-a4f0-1d330e52c1e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "id": "4", "name": "m1.large", "disk": 80, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:34.877900 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-2ba4de76-1407-4e02-a4f0-1d330e52c1e2 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076338 Jun 16 17:15:34.879237 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 16/31] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jun 16 17:15:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:15:34.891103 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-a800b707-0d3f-4d34-92db-b70d1d6b0502 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:34.913852 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-a800b707-0d3f-4d34-92db-b70d1d6b0502 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026718 Jun 16 17:15:34.914427 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 16/32] 10.222.0.66 () {64 vars in 1332 bytes} [Thu Jun 16 17:15:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:15:37.076352 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-2ba4de76-1407-4e02-a4f0-1d330e52c1e2 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:15:37.078021 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-2ba4de76-1407-4e02-a4f0-1d330e52c1e2 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 Jun 16 17:15:37.078415 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 17/33] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jun 16 17:15:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:15:37.138295 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-5bd6c819-2ba4-4bc2-b19f-c4d855c0fe8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8, "id": "5", "name": "m1.xlarge", "disk": 160}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:37.157224 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-5bd6c819-2ba4-4bc2-b19f-c4d855c0fe8e admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.072967 Jun 16 17:15:37.157849 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 17/34] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jun 16 17:15:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:15:37.169656 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-a0e29329-c181-43a0-bf3e-053119722066 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:15:37.194258 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-a0e29329-c181-43a0-bf3e-053119722066 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028353 Jun 16 17:15:37.194937 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 18/35] 10.222.0.66 () {64 vars in 1332 bytes} [Thu Jun 16 17:15:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:16:01.075407 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-5bd6c819-2ba4-4bc2-b19f-c4d855c0fe8e admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:01.076930 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-5bd6c819-2ba4-4bc2-b19f-c4d855c0fe8e admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002122 Jun 16 17:16:01.078161 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 18/36] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jun 16 17:16:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:16:01.091134 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:01.142854 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-501c8b61-8c5d-4aff-8598-57b2daee2201 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:01.160612 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-501c8b61-8c5d-4aff-8598-57b2daee2201 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.076402 Jun 16 17:16:01.161142 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 19/37] 10.222.0.66 () {60 vars in 1291 bytes} [Thu Jun 16 17:16:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:16:02.154054 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-5bd6c819-2ba4-4bc2-b19f-c4d855c0fe8e admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:02.155084 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-5bd6c819-2ba4-4bc2-b19f-c4d855c0fe8e admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 16 17:16:02.155534 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 19/38] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jun 16 17:16:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:16:02.357402 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-f743b8b5-fb48-41b1-9218-9058179b77d9 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:02.363873 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.wsgi [None req-f743b8b5-fb48-41b1-9218-9058179b77d9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-f743b8b5-fb48-41b1-9218-9058179b77d9 admin admin] Request method failure captured: Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Accept: application/json Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Accept-Encoding: gzip, deflate Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Connection: keep-alive Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Content-Length: 0 Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Host: 10.222.0.66 Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Openstack-Api-Version: compute 2.90 Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Openstack-System-Scope: None Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: User-Agent: python-novaclient Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Auth-Token: gAAAAABiq2VSeLvak4nYzOaATRXUWCchVcy9_ecqam7gz1YpQ28ONvZx9rZ0EVGzfQOLE-CplExKPJjHeAUbCmzrt24eDbLbfaff75iM-FmWlt-WiSOZ_c_-fO1JgEqW0zJiIJr466c0pGEXV8lglbwZ2dccqJaNnR60hODzOoP2z7LkmPxgrkY Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Domain-Id: None Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Domain-Name: None Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Identity-Status: Confirmed Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Is-Admin-Project: True Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Project-Domain-Id: default Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Project-Domain-Name: Default Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Project-Id: 546ad1026cd44cbea571239c12f41a3f Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Project-Name: admin Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Role: reader,admin,member Jun 16 17:16:02.367190 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Roles: reader,admin,member Jun 16 17:16:02.368682 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/546ad1026cd44cbea571239c12f41a3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/546ad1026cd44cbea571239c12f41a3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_546ad1026cd44cbea571239c12f41a3f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/546ad1026cd44cbea571239c12f41a3f"}]}] Jun 16 17:16:02.368682 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Tenant: admin Jun 16 17:16:02.368682 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Tenant-Id: 546ad1026cd44cbea571239c12f41a3f Jun 16 17:16:02.368682 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Tenant-Name: admin Jun 16 17:16:02.368682 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-User: admin Jun 16 17:16:02.368682 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-User-Domain-Id: default Jun 16 17:16:02.368682 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-User-Domain-Name: Default Jun 16 17:16:02.368682 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-User-Id: 918e7fd9b64348e38ccb56232b8e098a Jun 16 17:16:02.368682 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-User-Name: admin Jun 16 17:16:02.368682 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: method: > Jun 16 17:16:02.368682 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: exception: Flavor 42 could not be found. Jun 16 17:16:02.368682 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: action_args: {'id': '42'} Jun 16 17:16:02.368682 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:16:02.368682 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:16:02.369631 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jun 16 17:16:02.370796 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-f743b8b5-fb48-41b1-9218-9058179b77d9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:16:02.371873 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-f743b8b5-fb48-41b1-9218-9058179b77d9 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.070468 Jun 16 17:16:02.371873 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 20/39] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Jun 16 17:16:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:16:02.378483 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-834c4529-f819-45d1-8ccf-07842f072e91 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:02.381568 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:02.400960 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-834c4529-f819-45d1-8ccf-07842f072e91 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026244 Jun 16 17:16:02.401541 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 20/40] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Jun 16 17:16:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:16:02.414197 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-0804237c-1376-4c89-8718-5f1c3a41b590 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:02.442838 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-0804237c-1376-4c89-8718-5f1c3a41b590 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034417 Jun 16 17:16:02.443528 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 21/41] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Jun 16 17:16:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:16:02.453004 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-1fca5926-48f4-42c0-acbd-0589205ffbc0 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:02.459680 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.wsgi [None req-1fca5926-48f4-42c0-acbd-0589205ffbc0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-1fca5926-48f4-42c0-acbd-0589205ffbc0 admin admin] Request method failure captured: Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Accept: application/json Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Accept-Encoding: gzip, deflate Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Connection: keep-alive Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Content-Length: 0 Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Host: 10.222.0.66 Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Openstack-Api-Version: compute 2.90 Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Openstack-System-Scope: None Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: User-Agent: python-novaclient Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Auth-Token: gAAAAABiq2VSeLvak4nYzOaATRXUWCchVcy9_ecqam7gz1YpQ28ONvZx9rZ0EVGzfQOLE-CplExKPJjHeAUbCmzrt24eDbLbfaff75iM-FmWlt-WiSOZ_c_-fO1JgEqW0zJiIJr466c0pGEXV8lglbwZ2dccqJaNnR60hODzOoP2z7LkmPxgrkY Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Domain-Id: None Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Domain-Name: None Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Identity-Status: Confirmed Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Is-Admin-Project: True Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Project-Domain-Id: default Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Project-Domain-Name: Default Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Project-Id: 546ad1026cd44cbea571239c12f41a3f Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Project-Name: admin Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Role: reader,admin,member Jun 16 17:16:02.463248 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Roles: reader,admin,member Jun 16 17:16:02.464680 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/546ad1026cd44cbea571239c12f41a3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/546ad1026cd44cbea571239c12f41a3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_546ad1026cd44cbea571239c12f41a3f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/546ad1026cd44cbea571239c12f41a3f"}]}] Jun 16 17:16:02.464680 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Tenant: admin Jun 16 17:16:02.464680 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Tenant-Id: 546ad1026cd44cbea571239c12f41a3f Jun 16 17:16:02.464680 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Tenant-Name: admin Jun 16 17:16:02.464680 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-User: admin Jun 16 17:16:02.464680 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-User-Domain-Id: default Jun 16 17:16:02.464680 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-User-Domain-Name: Default Jun 16 17:16:02.464680 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-User-Id: 918e7fd9b64348e38ccb56232b8e098a Jun 16 17:16:02.464680 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-User-Name: admin Jun 16 17:16:02.464680 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: method: > Jun 16 17:16:02.464680 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: exception: Flavor 42 could not be found. Jun 16 17:16:02.464680 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: action_args: {'id': '42'} Jun 16 17:16:02.464680 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:16:02.464680 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:16:02.465570 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jun 16 17:16:02.466679 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-1fca5926-48f4-42c0-acbd-0589205ffbc0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:16:02.467798 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-1fca5926-48f4-42c0-acbd-0589205ffbc0 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015496 Jun 16 17:16:02.467798 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 21/42] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Jun 16 17:16:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:16:03.327606 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-0804237c-1376-4c89-8718-5f1c3a41b590 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:03.328676 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-0804237c-1376-4c89-8718-5f1c3a41b590 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001818 Jun 16 17:16:03.329071 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 22/43] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jun 16 17:16:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:16:03.524666 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-68e4f300-9cc4-4fde-9e56-f09c42564940 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:03.530681 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.wsgi [None req-68e4f300-9cc4-4fde-9e56-f09c42564940 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-68e4f300-9cc4-4fde-9e56-f09c42564940 admin admin] Request method failure captured: Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Accept: application/json Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Accept-Encoding: gzip, deflate Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Connection: keep-alive Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Content-Length: 0 Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Host: 10.222.0.66 Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Openstack-Api-Version: compute 2.90 Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Openstack-System-Scope: None Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: User-Agent: python-novaclient Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Auth-Token: gAAAAABiq2VTnait7K058VmgO8hFATfMNwbiB2vXAQH4TEoJ4a8VR7GfcFDhnF3Gsj4cCXe427TUhPls7NVK3rDIvRntV6JPPK94c4KyHw4N_lh45hjXSbXxhYN6JzZNIMPcuNORT45Iec36d3kyIC4HQTJBKSi-XjxfLGXx2hyg5_KoeW1gkGk Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Domain-Id: None Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Domain-Name: None Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Identity-Status: Confirmed Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Is-Admin-Project: True Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Project-Domain-Id: default Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Project-Domain-Name: Default Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Project-Id: 546ad1026cd44cbea571239c12f41a3f Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Project-Name: admin Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Role: reader,admin,member Jun 16 17:16:03.532121 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Roles: reader,admin,member Jun 16 17:16:03.533664 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/546ad1026cd44cbea571239c12f41a3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/546ad1026cd44cbea571239c12f41a3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_546ad1026cd44cbea571239c12f41a3f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/546ad1026cd44cbea571239c12f41a3f"}]}] Jun 16 17:16:03.533664 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Tenant: admin Jun 16 17:16:03.533664 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Tenant-Id: 546ad1026cd44cbea571239c12f41a3f Jun 16 17:16:03.533664 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Tenant-Name: admin Jun 16 17:16:03.533664 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-User: admin Jun 16 17:16:03.533664 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-User-Domain-Id: default Jun 16 17:16:03.533664 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-User-Domain-Name: Default Jun 16 17:16:03.533664 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-User-Id: 918e7fd9b64348e38ccb56232b8e098a Jun 16 17:16:03.533664 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-User-Name: admin Jun 16 17:16:03.533664 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: method: > Jun 16 17:16:03.533664 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: exception: Flavor 84 could not be found. Jun 16 17:16:03.533664 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: action_args: {'id': '84'} Jun 16 17:16:03.533664 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:16:03.533664 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:16:03.535883 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jun 16 17:16:03.537170 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-68e4f300-9cc4-4fde-9e56-f09c42564940 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:16:03.538528 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-68e4f300-9cc4-4fde-9e56-f09c42564940 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.067186 Jun 16 17:16:03.538528 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 22/44] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Jun 16 17:16:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:16:03.543405 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-bc99ee42-1164-4fc4-bb9f-9eaaeecc4fba admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:03.558966 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-bc99ee42-1164-4fc4-bb9f-9eaaeecc4fba admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019282 Jun 16 17:16:03.559497 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 23/45] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Jun 16 17:16:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:16:03.569306 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-150eae49-ce2f-45fa-ba84-2392ba098168 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:03.583442 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-150eae49-ce2f-45fa-ba84-2392ba098168 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017911 Jun 16 17:16:03.584230 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 23/46] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Jun 16 17:16:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:16:03.599546 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-625bba22-948b-46ae-8b90-664d9bf64506 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:03.609130 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.wsgi [None req-625bba22-948b-46ae-8b90-664d9bf64506 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-625bba22-948b-46ae-8b90-664d9bf64506 admin admin] Request method failure captured: Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Accept: application/json Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Accept-Encoding: gzip, deflate Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Connection: keep-alive Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Content-Length: 0 Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Host: 10.222.0.66 Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Openstack-Api-Version: compute 2.90 Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Openstack-System-Scope: None Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: User-Agent: python-novaclient Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Auth-Token: gAAAAABiq2VTnait7K058VmgO8hFATfMNwbiB2vXAQH4TEoJ4a8VR7GfcFDhnF3Gsj4cCXe427TUhPls7NVK3rDIvRntV6JPPK94c4KyHw4N_lh45hjXSbXxhYN6JzZNIMPcuNORT45Iec36d3kyIC4HQTJBKSi-XjxfLGXx2hyg5_KoeW1gkGk Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Domain-Id: None Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Domain-Name: None Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Identity-Status: Confirmed Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Is-Admin-Project: True Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Project-Domain-Id: default Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Project-Domain-Name: Default Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Project-Id: 546ad1026cd44cbea571239c12f41a3f Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Project-Name: admin Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Role: reader,admin,member Jun 16 17:16:03.610583 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Roles: reader,admin,member Jun 16 17:16:03.611926 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/546ad1026cd44cbea571239c12f41a3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/546ad1026cd44cbea571239c12f41a3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_546ad1026cd44cbea571239c12f41a3f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/546ad1026cd44cbea571239c12f41a3f"}]}] Jun 16 17:16:03.611926 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Tenant: admin Jun 16 17:16:03.611926 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Tenant-Id: 546ad1026cd44cbea571239c12f41a3f Jun 16 17:16:03.611926 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Tenant-Name: admin Jun 16 17:16:03.611926 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-User: admin Jun 16 17:16:03.611926 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-User-Domain-Id: default Jun 16 17:16:03.611926 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-User-Domain-Name: Default Jun 16 17:16:03.611926 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-User-Id: 918e7fd9b64348e38ccb56232b8e098a Jun 16 17:16:03.611926 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-User-Name: admin Jun 16 17:16:03.611926 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: method: > Jun 16 17:16:03.611926 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: exception: Flavor 84 could not be found. Jun 16 17:16:03.611926 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: action_args: {'id': '84'} Jun 16 17:16:03.611926 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:16:03.611926 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:16:03.612767 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jun 16 17:16:03.614066 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-625bba22-948b-46ae-8b90-664d9bf64506 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:16:03.615338 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-625bba22-948b-46ae-8b90-664d9bf64506 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.018002 Jun 16 17:16:03.615338 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 24/47] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Jun 16 17:16:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:16:04.478500 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-150eae49-ce2f-45fa-ba84-2392ba098168 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:04.479520 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-150eae49-ce2f-45fa-ba84-2392ba098168 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 16 17:16:04.479912 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 24/48] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jun 16 17:16:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:16:04.685661 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-bb515238-27ff-48e5-8abf-4838cc77a122 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:04.692204 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.wsgi [None req-bb515238-27ff-48e5-8abf-4838cc77a122 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-bb515238-27ff-48e5-8abf-4838cc77a122 admin admin] Request method failure captured: Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Accept: application/json Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Accept-Encoding: gzip, deflate Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Connection: keep-alive Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Content-Length: 0 Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Host: 10.222.0.66 Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Openstack-Api-Version: compute 2.90 Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Openstack-System-Scope: None Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: User-Agent: python-novaclient Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Auth-Token: gAAAAABiq2VU6g1GtS507J_jybZKUsyoA08RbEiAb3X4HBii1GiYqRTeYl7YjRFngGONe0TpDI4Z2IgIKJHbDtNuRWgWNcPgZAcD36hgdMldhkoTCMbqQVRUyGAFm4YqLxtdNxmI7rNH6LpAqFmvumv6j0RWFuaAvWu6fSBuN2wtt1OBeCYkJtI Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Domain-Id: None Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Domain-Name: None Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Identity-Status: Confirmed Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Is-Admin-Project: True Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Project-Domain-Id: default Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Project-Domain-Name: Default Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Project-Id: 546ad1026cd44cbea571239c12f41a3f Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Project-Name: admin Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Role: reader,admin,member Jun 16 17:16:04.693754 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Roles: reader,admin,member Jun 16 17:16:04.695240 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/546ad1026cd44cbea571239c12f41a3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/546ad1026cd44cbea571239c12f41a3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_546ad1026cd44cbea571239c12f41a3f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/546ad1026cd44cbea571239c12f41a3f"}]}] Jun 16 17:16:04.695240 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Tenant: admin Jun 16 17:16:04.695240 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Tenant-Id: 546ad1026cd44cbea571239c12f41a3f Jun 16 17:16:04.695240 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-Tenant-Name: admin Jun 16 17:16:04.695240 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-User: admin Jun 16 17:16:04.695240 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-User-Domain-Id: default Jun 16 17:16:04.695240 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-User-Domain-Name: Default Jun 16 17:16:04.695240 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-User-Id: 918e7fd9b64348e38ccb56232b8e098a Jun 16 17:16:04.695240 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: X-User-Name: admin Jun 16 17:16:04.695240 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: method: > Jun 16 17:16:04.695240 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: exception: Flavor 451 could not be found. Jun 16 17:16:04.695240 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: action_args: {'id': '451'} Jun 16 17:16:04.695240 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:16:04.695240 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:16:04.696119 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jun 16 17:16:04.697259 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-bb515238-27ff-48e5-8abf-4838cc77a122 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:16:04.698402 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-bb515238-27ff-48e5-8abf-4838cc77a122 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.076575 Jun 16 17:16:04.698402 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 25/49] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Jun 16 17:16:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:16:04.704939 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-513c5b53-6bb0-4e60-a2bd-6847bac2bca7 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:04.721018 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-513c5b53-6bb0-4e60-a2bd-6847bac2bca7 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019802 Jun 16 17:16:04.721621 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 25/50] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Jun 16 17:16:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:16:04.731071 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-9fd24316-9cfc-4be8-aff8-01d469990d16 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:04.745668 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-9fd24316-9cfc-4be8-aff8-01d469990d16 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018077 Jun 16 17:16:04.746197 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 26/51] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Jun 16 17:16:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:16:04.757935 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-02a523ff-41dd-45a1-afaa-fe3fcac99a7a admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:04.765872 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.wsgi [None req-02a523ff-41dd-45a1-afaa-fe3fcac99a7a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-02a523ff-41dd-45a1-afaa-fe3fcac99a7a admin admin] Request method failure captured: Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Accept: application/json Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Accept-Encoding: gzip, deflate Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Connection: keep-alive Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Content-Length: 0 Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Host: 10.222.0.66 Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Openstack-Api-Version: compute 2.90 Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Openstack-System-Scope: None Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: User-Agent: python-novaclient Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Auth-Token: gAAAAABiq2VU6g1GtS507J_jybZKUsyoA08RbEiAb3X4HBii1GiYqRTeYl7YjRFngGONe0TpDI4Z2IgIKJHbDtNuRWgWNcPgZAcD36hgdMldhkoTCMbqQVRUyGAFm4YqLxtdNxmI7rNH6LpAqFmvumv6j0RWFuaAvWu6fSBuN2wtt1OBeCYkJtI Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Domain-Id: None Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Domain-Name: None Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Identity-Status: Confirmed Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Is-Admin-Project: True Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Project-Domain-Id: default Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Project-Domain-Name: Default Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Project-Id: 546ad1026cd44cbea571239c12f41a3f Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Project-Name: admin Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Role: reader,admin,member Jun 16 17:16:04.768107 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Roles: reader,admin,member Jun 16 17:16:04.769612 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/546ad1026cd44cbea571239c12f41a3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/546ad1026cd44cbea571239c12f41a3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_546ad1026cd44cbea571239c12f41a3f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/546ad1026cd44cbea571239c12f41a3f"}]}] Jun 16 17:16:04.769612 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Tenant: admin Jun 16 17:16:04.769612 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Tenant-Id: 546ad1026cd44cbea571239c12f41a3f Jun 16 17:16:04.769612 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-Tenant-Name: admin Jun 16 17:16:04.769612 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-User: admin Jun 16 17:16:04.769612 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-User-Domain-Id: default Jun 16 17:16:04.769612 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-User-Domain-Name: Default Jun 16 17:16:04.769612 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-User-Id: 918e7fd9b64348e38ccb56232b8e098a Jun 16 17:16:04.769612 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: X-User-Name: admin Jun 16 17:16:04.769612 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: method: > Jun 16 17:16:04.769612 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: exception: Flavor 451 could not be found. Jun 16 17:16:04.769612 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: action_args: {'id': '451'} Jun 16 17:16:04.769612 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:16:04.769612 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:16:04.770533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: ERROR nova.api.openstack.wsgi Jun 16 17:16:04.772058 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-02a523ff-41dd-45a1-afaa-fe3fcac99a7a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:16:04.773347 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-02a523ff-41dd-45a1-afaa-fe3fcac99a7a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.017266 Jun 16 17:16:04.773347 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 26/52] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Jun 16 17:16:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:16:05.632766 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-9fd24316-9cfc-4be8-aff8-01d469990d16 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:05.633838 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-9fd24316-9cfc-4be8-aff8-01d469990d16 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 16 17:16:05.634229 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 27/53] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jun 16 17:16:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:16:05.836003 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-64f103fd-7f7e-471b-b5fa-f66dbcc2e3bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:16:05.857144 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-64f103fd-7f7e-471b-b5fa-f66dbcc2e3bb admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.084823 Jun 16 17:16:05.857785 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 27/54] 10.222.0.66 () {64 vars in 1235 bytes} [Thu Jun 16 17:16:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:16:06.722284 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-9fd24316-9cfc-4be8-aff8-01d469990d16 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:06.723283 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-9fd24316-9cfc-4be8-aff8-01d469990d16 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 16 17:16:06.723677 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 28/55] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jun 16 17:16:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:16:06.923287 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-bb7c3012-b4b1-42c0-9fa2-1bffad59fd4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:16:06.943088 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-bb7c3012-b4b1-42c0-9fa2-1bffad59fd4c admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.081878 Jun 16 17:16:06.943631 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 28/56] 10.222.0.66 () {64 vars in 1235 bytes} [Thu Jun 16 17:16:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:16:07.833888 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-9fd24316-9cfc-4be8-aff8-01d469990d16 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:07.834894 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-9fd24316-9cfc-4be8-aff8-01d469990d16 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 16 17:16:07.835286 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 29/57] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jun 16 17:16:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:16:08.039533 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-c08fb740-98c7-4b4e-9015-099d1be385ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:16:08.062831 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-c08fb740-98c7-4b4e-9015-099d1be385ae admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.088840 Jun 16 17:16:08.063402 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 29/58] 10.222.0.66 () {64 vars in 1235 bytes} [Thu Jun 16 17:16:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:16:08.952133 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-9fd24316-9cfc-4be8-aff8-01d469990d16 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:08.953463 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-9fd24316-9cfc-4be8-aff8-01d469990d16 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 Jun 16 17:16:08.953849 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 30/59] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jun 16 17:16:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:16:09.151101 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-0bff823f-5dd3-4ed4-b468-c232b5f6c7c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:16:09.169780 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-0bff823f-5dd3-4ed4-b468-c232b5f6c7c2 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.078606 Jun 16 17:16:09.170250 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 30/60] 10.222.0.66 () {64 vars in 1235 bytes} [Thu Jun 16 17:16:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:16:10.040385 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-9fd24316-9cfc-4be8-aff8-01d469990d16 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:10.041431 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-9fd24316-9cfc-4be8-aff8-01d469990d16 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 16 17:16:10.041825 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 31/61] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jun 16 17:16:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:16:10.235039 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-800ef97e-e639-4873-9362-5061ed725de6 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:10.258391 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-800ef97e-e639-4873-9362-5061ed725de6 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.080104 Jun 16 17:16:10.258839 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 31/62] 10.222.0.66 () {60 vars in 1202 bytes} [Thu Jun 16 17:16:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:16:59.653588 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-9fd24316-9cfc-4be8-aff8-01d469990d16 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:59.654590 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-9fd24316-9cfc-4be8-aff8-01d469990d16 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jun 16 17:16:59.655020 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 32/63] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jun 16 17:16:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:16:59.662094 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:59.717719 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-dbfe1f05-cb1d-423d-86c8-f74b52997590 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:59.738399 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-dbfe1f05-cb1d-423d-86c8-f74b52997590 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077165 Jun 16 17:16:59.738942 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 32/64] 10.222.0.66 () {60 vars in 1291 bytes} [Thu Jun 16 17:16:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:16:59.769096 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-5a1e5eef-dfcb-4b17-8e26-1129c7c1e116 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:59.772490 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_api:SELECT=14 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:59.778422 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-5a1e5eef-dfcb-4b17-8e26-1129c7c1e116 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014780 Jun 16 17:16:59.778945 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 33/65] 10.222.0.66 () {60 vars in 1282 bytes} [Thu Jun 16 17:16:59 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:59.793786 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-539b705d-55b7-45db-8192-14715ea0e754 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:59.803707 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-539b705d-55b7-45db-8192-14715ea0e754 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015984 Jun 16 17:16:59.804229 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 33/66] 10.222.0.66 () {60 vars in 1285 bytes} [Thu Jun 16 17:16:59 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:59.815831 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-21ceed18-7f39-4f8b-ac4a-51f7c806be84 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:59.823865 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-21ceed18-7f39-4f8b-ac4a-51f7c806be84 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011761 Jun 16 17:16:59.824382 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 34/67] 10.222.0.66 () {60 vars in 1285 bytes} [Thu Jun 16 17:16:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:59.839835 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-e70264f8-e799-4056-af4d-45a5617858b4 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:16:59.851232 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-e70264f8-e799-4056-af4d-45a5617858b4 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016161 Jun 16 17:16:59.851972 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 34/68] 10.222.0.66 () {60 vars in 1282 bytes} [Thu Jun 16 17:16:59 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:20:23.857164 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-21ceed18-7f39-4f8b-ac4a-51f7c806be84 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:20:23.858323 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-21ceed18-7f39-4f8b-ac4a-51f7c806be84 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Jun 16 17:20:23.858837 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 35/69] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jun 16 17:20:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:20:24.025782 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writing DB stats nova_api:SELECT=6 {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:24.158183 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-52fd7270-e911-49d3-b919-1f3ced50f32c admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:20:24.159431 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:20:24.159431 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: warnings.warn(msg) Jun 16 17:20:24.160695 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-52fd7270-e911-49d3-b919-1f3ced50f32c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:20:24.161143 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-52fd7270-e911-49d3-b919-1f3ced50f32c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:20:24.161950 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-52fd7270-e911-49d3-b919-1f3ced50f32c admin admin] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:20:24.162418 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-52fd7270-e911-49d3-b919-1f3ced50f32c admin admin] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:20:24.200610 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-52fd7270-e911-49d3-b919-1f3ced50f32c admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.176323 Jun 16 17:20:24.201465 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 35/70] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Jun 16 17:20:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:20:25.118403 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-21ceed18-7f39-4f8b-ac4a-51f7c806be84 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:20:25.119463 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-21ceed18-7f39-4f8b-ac4a-51f7c806be84 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jun 16 17:20:25.119917 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 36/71] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jun 16 17:20:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:20:25.321515 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-0f360477-b4ef-4ca6-8907-20910fca1041 admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:20:25.322732 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:20:25.322732 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: warnings.warn(msg) Jun 16 17:20:25.323978 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-0f360477-b4ef-4ca6-8907-20910fca1041 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:20:25.324501 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-0f360477-b4ef-4ca6-8907-20910fca1041 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:20:25.325352 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-0f360477-b4ef-4ca6-8907-20910fca1041 admin admin] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:20:25.325765 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-0f360477-b4ef-4ca6-8907-20910fca1041 admin admin] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:20:25.347157 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-0f360477-b4ef-4ca6-8907-20910fca1041 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081115 Jun 16 17:20:25.347754 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 36/72] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Jun 16 17:20:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:20:36.651722 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-21ceed18-7f39-4f8b-ac4a-51f7c806be84 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:20:36.652733 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-21ceed18-7f39-4f8b-ac4a-51f7c806be84 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 16 17:20:36.653127 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 37/73] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jun 16 17:20:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:20:36.795065 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writing DB stats nova_cell0:SELECT=4 {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:36.795945 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writing DB stats nova_cell1:SELECT=4 {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:36.796549 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG dbcounter [-] [103176] Writing DB stats nova_api:SELECT=8 {{(pid=103176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:36.850406 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-0422f751-8c81-47f0-b3e7-804bd84e188b admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:20:36.852507 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:20:36.852507 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: warnings.warn(msg) Jun 16 17:20:36.853752 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-0422f751-8c81-47f0-b3e7-804bd84e188b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:20:36.854190 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-0422f751-8c81-47f0-b3e7-804bd84e188b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:20:36.854972 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-0422f751-8c81-47f0-b3e7-804bd84e188b admin admin] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:20:36.855390 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-0422f751-8c81-47f0-b3e7-804bd84e188b admin admin] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:20:36.881279 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-0422f751-8c81-47f0-b3e7-804bd84e188b admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090471 Jun 16 17:20:36.881753 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 37/74] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Jun 16 17:20:36 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:20:37.794469 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-21ceed18-7f39-4f8b-ac4a-51f7c806be84 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:20:37.795529 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-21ceed18-7f39-4f8b-ac4a-51f7c806be84 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Jun 16 17:20:37.795939 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 38/75] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jun 16 17:20:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:20:38.005244 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG nova.api.openstack.wsgi [None req-7762ba18-0398-45f6-a3fc-511783caeaec admin admin] Calling method '>' {{(pid=103176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:20:38.006462 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:20:38.006462 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: warnings.warn(msg) Jun 16 17:20:38.007818 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-7762ba18-0398-45f6-a3fc-511783caeaec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:20:38.008243 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-7762ba18-0398-45f6-a3fc-511783caeaec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:20:38.008998 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-7762ba18-0398-45f6-a3fc-511783caeaec admin admin] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:20:38.009442 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: DEBUG oslo_concurrency.lockutils [None req-7762ba18-0398-45f6-a3fc-511783caeaec admin admin] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:20:38.032336 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: INFO nova.api.openstack.requestlog [None req-7762ba18-0398-45f6-a3fc-511783caeaec admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.091234 Jun 16 17:20:38.032919 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: [pid: 103176|app: 0|req: 38/76] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Jun 16 17:20:37 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:21:34.943493 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: Thu Jun 16 17:21:34 2022 - graceful shutdown triggered... Jun 16 17:21:34.943617 dv-cinder-837356-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 17:21:34.944485 dv-cinder-837356-2-iscsi devstack@n-api.service[103177]: Gracefully killing worker 2 (pid: 103177)... Jun 16 17:21:34.944854 dv-cinder-837356-2-iscsi devstack@n-api.service[103176]: Gracefully killing worker 1 (pid: 103176)... Jun 16 17:21:35.945387 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: worker 1 buried after 1 seconds Jun 16 17:21:35.946234 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: worker 2 buried after 1 seconds Jun 16 17:21:35.946234 dv-cinder-837356-2-iscsi devstack@n-api.service[103175]: goodbye to uWSGI. Jun 16 17:21:35.947241 dv-cinder-837356-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 17:21:35.948024 dv-cinder-837356-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 17:21:35.951297 dv-cinder-837356-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 17:21:35.964155 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 17:21:35.967196 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 17:21:35 2022] *** Jun 16 17:21:35.967451 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 17:21:35.967655 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 17:21:35.967838 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: nodename: dv-cinder-837356-2-iscsi Jun 16 17:21:35.968018 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: machine: x86_64 Jun 16 17:21:35.968206 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: clock source: unix Jun 16 17:21:35.968431 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: pcre jit disabled Jun 16 17:21:35.968431 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: detected number of CPU cores: 4 Jun 16 17:21:35.968431 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: current working directory: / Jun 16 17:21:35.968431 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: detected binary path: /usr/bin/uwsgi-core Jun 16 17:21:35.968431 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: your processes number limit is 47680 Jun 16 17:21:35.968431 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: your memory page size is 4096 bytes Jun 16 17:21:35.968431 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: detected max file descriptor number: 2048 Jun 16 17:21:35.968431 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: lock engine: pthread robust mutexes Jun 16 17:21:35.969003 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: thunder lock: enabled Jun 16 17:21:35.969003 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 17:21:35.969003 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 17:21:36.016921 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: Python main interpreter initialized at 0x55f3614ae9c0 Jun 16 17:21:36.016921 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: python threads support enabled Jun 16 17:21:36.016921 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: your server socket listen backlog is limited to 100 connections Jun 16 17:21:36.016921 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: your mercy for graceful operations on workers is 90 seconds Jun 16 17:21:36.017425 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 17:21:36.017425 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: *** Operational MODE: preforking *** Jun 16 17:21:36.017768 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: *** uWSGI is running in multiple interpreter mode *** Jun 16 17:21:36.017768 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: spawned uWSGI master process (pid: 117535) Jun 16 17:21:36.017998 dv-cinder-837356-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 17:21:36.020341 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: spawned uWSGI worker 1 (pid: 117552, cores: 1) Jun 16 17:21:36.020341 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: spawned uWSGI worker 2 (pid: 117553, cores: 1) Jun 16 17:21:36.020341 dv-cinder-837356-2-iscsi devstack@n-api.service[117535]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 17:21:36.697663 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 17:21:36.705013 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 17:21:37.952774 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:21:37.952774 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: from cryptography.utils import int_from_bytes Jun 16 17:21:37.953887 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:21:37.953887 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: from cryptography.utils import int_from_bytes Jun 16 17:21:38.012735 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:21:38.012735 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: from cryptography.utils import int_from_bytes Jun 16 17:21:38.013393 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:21:38.013393 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: from cryptography.utils import int_from_bytes Jun 16 17:21:40.345331 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:21:40.345845 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:21:40.346091 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:21:40.346456 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:21:40.346711 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:21:40.347095 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.347421 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.347745 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.348064 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.348443 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.348706 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.349020 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.349374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.349699 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.349961 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.350279 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.350596 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837356-2-iscsi {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.350919 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.351224 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.351530 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.351903 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.352213 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.352534 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.352842 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.353359 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.354104 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.359460 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.359460 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.359460 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.359460 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.359460 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.359460 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.359460 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.359460 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.360600 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.360600 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837356-2-iscsi {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.360600 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.360600 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.360600 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.360600 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.360600 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.360600 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.362395 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.362395 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.362395 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.362395 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.362395 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.362395 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.362395 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.362395 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.363817 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.363817 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.363817 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.363817 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.363817 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.363817 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.363817 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.364604 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.364604 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.364604 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.365029 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.365029 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.365322 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.365617 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.365915 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.366219 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.366534 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.366839 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.367141 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.367480 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.367785 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.368079 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.368397 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.368712 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.369036 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.369364 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.369682 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.370089 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.370389 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.370632 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.370974 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.371292 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.371594 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.371910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.372239 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.372544 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.372852 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.373318 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.373522 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.373832 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.374134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.374403 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.374687 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.374990 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.375305 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.375605 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.375914 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.376219 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.376519 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.377734 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.377734 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.377734 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.377734 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.379069 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.379069 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.379069 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.379069 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.380751 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.380751 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.380751 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.380751 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.380751 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.381150 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.381311 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.381615 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.385712 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.385712 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.385712 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.385712 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.385712 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.385712 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.385712 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.385712 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.386542 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.386542 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.386542 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.386542 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.386542 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.386542 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.387155 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.387673 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.387673 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.388026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.388266 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.388603 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.388882 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.389221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.389553 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.393508 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.393508 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.393508 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.393508 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.393508 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.393508 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.393508 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.393508 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.394154 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.394154 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.394154 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.394154 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.394154 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.394154 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.394154 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.394871 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.395036 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.395348 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.395666 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.395997 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.396311 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.396664 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.396978 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.397319 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.397634 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.397961 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.398289 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.398635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.399038 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.399361 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.399704 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.400036 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.400339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.400680 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.400963 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.401337 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.401620 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.401952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.402232 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.402737 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.403062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.403378 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.403684 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.403997 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.404305 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.404650 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.404967 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.405291 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.405602 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.405950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.406300 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.406619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.406968 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.407272 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.407575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.407883 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.408195 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.408517 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.408847 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.409159 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.409492 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.409829 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.410138 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.410445 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.410754 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.411062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.411366 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.411677 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.411985 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.412289 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.412612 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.412928 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.413256 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.413580 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.413885 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.414275 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.414761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.415007 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.415338 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.415652 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.415964 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.416293 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.416606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.416914 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.417278 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.417610 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.417915 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.418238 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.418561 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.418876 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.419181 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.419490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.419792 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.420096 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.420399 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.420703 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.421002 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.421380 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.421650 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.421923 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.422223 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.422545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.422857 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.423159 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.423457 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.423757 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.424101 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.424406 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.424749 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.425087 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.425429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.425749 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.426058 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.426371 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.426678 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.426985 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.427289 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.427596 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.427915 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.428220 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.428535 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.428842 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.429163 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.429493 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.430170 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.430699 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.431224 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.431574 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.431916 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.432234 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.432553 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.432862 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.433216 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.433513 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.433820 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.434278 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.434734 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.435055 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.435369 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.435686 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.435994 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.436545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.436634 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.437005 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.437308 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.437554 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.437883 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.438212 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.438518 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.438825 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.439144 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.439453 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.439761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.440068 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.440370 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.440673 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.440978 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.441314 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.441623 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.441931 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.442230 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.442541 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.442848 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.443153 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.443452 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.443759 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.444080 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.444388 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.444705 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.445023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.445384 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.445718 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.446038 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.446350 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.446647 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.446950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.447253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.447599 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.447909 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.448213 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.448529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.448847 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.449156 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.449493 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.449802 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.450109 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.450426 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.450738 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.451046 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.451354 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.451662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.451969 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.452276 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.452594 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.452907 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.453328 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.453670 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.453834 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.454142 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.454471 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.455043 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.455379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.455696 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.456017 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.456338 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.456662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.456995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.457351 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.457692 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.458201 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.458843 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.459037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.459412 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.459618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.459961 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.460233 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.460537 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.460847 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.461438 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.461789 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.462090 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.462402 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.462720 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.463026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.463340 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.463643 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.463969 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.464278 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.464579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.464884 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.465266 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.465646 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.465955 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.466298 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.466631 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.466972 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.467276 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.467583 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.467904 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.468207 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.468511 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.468815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.469125 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.469461 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.470090 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.470090 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.470392 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.470652 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.470961 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.471264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.471569 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.471900 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.472212 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.472517 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.472823 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.473122 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.473429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.473749 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.474048 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.474355 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.474655 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.474933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.475235 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.475536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.475836 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.476141 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.476499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.476830 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.477210 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.477444 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.477750 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.479215 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.479215 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.479215 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.479215 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.479805 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.479946 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.480131 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.480807 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.480807 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.481159 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.481357 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.481630 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.481938 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.482238 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.482540 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.482845 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.483146 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.483447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.483766 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.484072 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.484373 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.484675 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.484975 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.485603 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.485776 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.485980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.486285 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.486624 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.486906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.487296 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.487516 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.487824 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.488124 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.488438 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.488819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.489225 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.489398 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.489724 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.490002 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.490357 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.490637 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.491149 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.491379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.491587 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.491813 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.492115 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.492456 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.492765 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.493418 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.493418 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.493884 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.494057 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.494286 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.494595 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.494903 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.495342 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.495511 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.495802 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.496104 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.497382 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.497382 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.497382 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.497382 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.498042 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.498042 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.498327 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.499784 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.499784 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.499784 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.499784 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.499784 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.500501 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.500501 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.500788 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.500938 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.501551 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.501714 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.501986 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.502300 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.502606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.502907 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.503216 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.503538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.503841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.504143 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.504447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.504764 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.505065 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.505452 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.505836 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.506147 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.506452 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.506862 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.507167 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.507475 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.508137 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.508434 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.508840 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.509144 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.509516 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.509797 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.510119 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.510442 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.510753 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.511065 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.511369 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.511737 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.512004 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.512312 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.512637 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.513056 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.513401 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.513710 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.514070 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.514350 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.514651 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.514952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.515259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.515574 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.515861 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.516182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.516484 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.516791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.517100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.517440 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.517716 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.518018 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.518336 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.518636 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.518972 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.519274 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.519667 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.519896 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.520200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.520518 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.520823 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.521123 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.521450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.521762 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.522100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.522408 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.522733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.523063 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.523391 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.523743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.524076 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.524405 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.524718 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.525034 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.525380 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.525700 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.525979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.533105 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.533105 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.533105 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.533105 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.533105 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.533105 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.533105 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.533105 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.534302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.534302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.534302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.534302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.534302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.534302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.534302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.534302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.536467 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.536467 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.536467 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.536467 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.536467 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.536467 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.536467 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.536467 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.537645 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.537645 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.537645 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.537645 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.538184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:21:40.538662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.538819 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:21:40.538962 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.538962 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.539523 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:21:40.539681 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.539835 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:21:40.539985 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.540137 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:21:40.540293 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.540442 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.540592 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.540733 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.540987 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.540987 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.541297 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.541451 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.541592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.541740 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.541906 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.542055 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.542198 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.542338 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.542479 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.543452 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.543621 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.543772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.543934 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.544213 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.544382 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.544535 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.544703 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.544845 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.544986 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837356-2-iscsi {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.545134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.545314 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.545458 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.545610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.545751 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.545909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.546140 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.546286 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.546442 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.546593 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.546753 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.546894 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.547035 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.547175 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.547328 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.547328 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.547609 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.547777 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.547920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.548080 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.548232 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.548380 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.548522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.548663 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.548812 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.548962 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.549104 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.549296 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.549443 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.549585 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.549735 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.549884 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.550027 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.550177 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.550318 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.550459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.550615 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.550765 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.550765 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.551042 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837356-2-iscsi {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.551042 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.551326 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.551468 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.551618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.551759 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.551910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.551910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.552211 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.552354 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.552495 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.552645 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.552912 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.552912 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.553856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.554001 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.554142 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.554284 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.554433 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.554605 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.554804 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.554948 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.555113 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.555352 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.555520 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.555673 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.555833 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.555976 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.556137 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.556435 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.556599 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.556808 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.557037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.557295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.557450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.557646 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.557854 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.558013 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.558165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.558386 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.558559 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.559440 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.559624 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.559770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.559929 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.560152 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.560375 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.560604 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.560604 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.560999 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.561195 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.561363 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.561510 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.561510 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.561807 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.561975 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.562134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.562291 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.562538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.562699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.562917 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.562917 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.564222 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.564406 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.564702 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.564914 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.565074 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.565351 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.565573 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.565759 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.565962 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.566123 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.566123 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.566436 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.566745 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.566912 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.567073 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.567223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.567381 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.567531 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.567680 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.567841 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.568000 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.568000 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.568371 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.568371 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.568984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.569149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.569327 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.569327 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.569633 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.569782 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.570087 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.570251 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.570629 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.570792 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.570949 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.571099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.571247 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.571475 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.571687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.571851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.572001 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.572149 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.572305 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.572550 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.572758 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.572908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.573065 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.573237 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.574270 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.574430 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.574430 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.574723 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.574881 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.575037 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.575195 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.575353 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.575517 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.575679 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.575828 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.575828 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.576119 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.576276 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.576425 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.576573 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.576746 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.577001 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.577164 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.577421 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.577572 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.577727 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.577896 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.578061 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.578210 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.578367 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.578516 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.578664 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.578812 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.578812 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.579125 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.579275 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.579432 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.579590 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.579738 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.579912 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.579912 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.580198 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.580355 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.580511 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.580661 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.580822 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.580971 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.581221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.581412 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.582193 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.582193 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.582517 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.582666 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.582815 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.582978 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.582978 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.582978 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.582978 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.582978 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.582978 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.582978 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.582978 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.584993 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.585144 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.585528 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.585701 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.585852 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.585852 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.586211 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.586361 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.586541 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.586789 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.587032 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.587401 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.587569 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.587728 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.587905 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.588063 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.588212 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.588371 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.588520 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.588678 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.588854 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.589146 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.589340 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.589508 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.589665 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.589821 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.589980 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.590145 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.590294 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.590443 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.590593 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.590750 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.590899 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.591047 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.591194 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.591350 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.591500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.591657 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.591806 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.591961 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.592128 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.592278 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.592435 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.592594 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.592752 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.592900 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.593055 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.593273 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.593429 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.593592 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.593750 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.594449 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.594846 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.595011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.595176 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:21:40.595327 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.595483 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.595634 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.595783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.595939 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.596102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.596260 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.596409 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.596613 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.596772 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.596943 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.597135 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.597309 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.597569 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.597731 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.597880 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.598043 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.598195 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.598343 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.598500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.598657 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.598816 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.598984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.598984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.599274 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.599431 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.599588 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.599736 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.599894 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.600051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.600210 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.600359 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.600515 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.600664 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.600822 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.600982 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.601130 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.601340 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.601498 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.601794 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.601957 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.602107 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.602107 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.602398 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.602548 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.602711 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.602860 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.603010 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.603177 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.603366 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.603875 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.604060 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.605105 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.605297 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.605450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.605599 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.605755 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.605918 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.606068 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.606226 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.606388 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.606537 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.606821 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.607059 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.607262 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.607415 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.607592 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.607858 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.608023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.608182 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.608333 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.608517 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.608762 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.608969 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.609136 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.609359 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.609528 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.609528 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.609821 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.609821 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.610116 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.610116 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.610417 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.610566 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.610723 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.610882 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.610882 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.611183 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.611332 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.611490 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.611646 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.611804 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.611954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.612113 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.612269 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.612427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.612585 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.612743 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.612903 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.613051 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.613219 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.613374 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.613525 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.613691 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.613841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.613989 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.614165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.615337 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.615508 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.615669 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.615818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.615977 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.616126 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.616274 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.616433 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.616583 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.616732 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.616890 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.617047 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.617340 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.617509 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.617662 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.617837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.618088 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.618261 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.618426 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.618576 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.618766 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.618984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.618984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.619351 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.619517 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.619670 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.619848 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.620143 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.620296 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.620468 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.620626 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.620777 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.620935 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.621093 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.621277 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.621431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.621579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.621728 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.621885 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.622047 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.622212 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:21:40.622362 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.622362 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.622362 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.622362 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.622362 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.622362 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.622362 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.622362 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.624028 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.624028 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.624028 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.624028 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.624028 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.624028 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.624028 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.624028 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.627139 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.627139 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.627139 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.627139 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.627139 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.627139 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.627139 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.627139 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.628986 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.628986 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.628986 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.628986 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.628986 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.628986 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.628986 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.628986 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.630311 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.630311 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.630311 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.630311 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.630311 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.630311 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.630311 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.630311 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.631446 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.631446 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.631446 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.631446 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.631446 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.631446 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.631446 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.631446 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.632546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.632546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.632546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.632546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.632546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.632546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.632546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.632546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.633963 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.633963 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.633963 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.633963 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.633963 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.633963 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.633963 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.633963 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.635566 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.635566 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.635566 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.635566 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.635566 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.635566 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.635566 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.635566 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.637099 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.637099 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.637099 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.637099 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.637099 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.637099 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.637099 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.637099 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.638276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.638276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.638276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.638276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.638276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.638276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.638276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.638276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.639563 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.639563 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.639563 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.639563 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.639563 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.639563 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.639563 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.639563 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.641109 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.641109 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.641109 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.641109 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.641109 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.641109 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.641109 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.641109 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.642286 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.642286 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.642286 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.642286 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.642286 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.642993 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.642993 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.643283 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.643439 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.643661 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.643972 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.644303 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.644591 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.646266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.646266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.646266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.646266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.646266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.647011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.647011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.647303 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.647614 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.647945 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.648259 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.648623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.649131 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.649710 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.650052 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.650383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.650728 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.651037 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.651349 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.651657 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.651964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.652283 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.652589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.652895 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.653224 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.653537 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.653844 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.654149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.654920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.654920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.655242 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.655390 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.655640 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.656535 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.656535 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.656535 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.656988 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.657160 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.657435 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.657778 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.658084 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.658427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.658757 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.659401 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.659401 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.659707 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.659987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.660291 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.660593 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.660896 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.661221 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.661534 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.662297 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.662297 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.662595 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.663671 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.663671 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.663671 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.663671 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.664552 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.664552 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.665252 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.665410 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.665723 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.666416 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.666416 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.666999 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.666999 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.667293 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.667510 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.667812 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.668113 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.668414 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.668721 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.669009 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.669338 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.669665 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.669832 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO dbcounter [None req-6e82ea9e-5069-4166-a78c-6fa9969b7f01 None None] Registered counter for database nova_api Jun 16 17:21:40.669997 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.670267 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.670569 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.670924 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.671173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.671474 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.671780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.672099 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.672414 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.672739 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.673015 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.673342 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.673646 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.673949 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.674256 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.674557 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.674857 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.675156 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.675457 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.675756 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.676119 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.676621 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.677018 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.677018 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.677356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.677596 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.677899 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.678258 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.678563 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.678875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.679479 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.680377 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.680801 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.681131 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.681470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.681791 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.682285 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.682601 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.682981 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.683290 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.683618 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.683930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.684240 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.685710 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.685710 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.685710 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.685710 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.686225 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.686225 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.686471 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.686685 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.686993 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.687304 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.687617 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.687925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.688235 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.688543 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.688848 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.689258 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.689558 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.689861 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.690185 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.690432 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_db.sqlalchemy.engines [None req-6e82ea9e-5069-4166-a78c-6fa9969b7f01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:21:40.690592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.690781 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.691087 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.691395 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.691698 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.692002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.692443 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.692758 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.693068 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.693399 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.693707 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.694015 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.694332 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.694645 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.694947 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.695625 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.695773 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.696036 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.696316 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.696764 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.696926 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.697358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.697686 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.697881 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writer thread running {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:21:40.698039 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.698304 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.698575 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.698893 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.699194 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.699512 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.699933 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.700242 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.700543 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.700957 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.701292 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.701604 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.701924 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.702244 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.702566 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.702872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.703182 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.703489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.703875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.704236 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.704546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.704859 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.705157 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.705519 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.705850 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.706146 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.706465 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.706929 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.707311 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.707497 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.707819 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.708143 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.708448 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.708747 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.709102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.709433 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.709816 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.711402 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.711733 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.712062 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.712387 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.712718 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.713036 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.713381 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.713712 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.714022 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.714349 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.714677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.715053 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.715504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.715820 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.716147 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.716459 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.716768 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.717076 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.717418 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.717764 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.718073 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.718399 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.718726 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.719057 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.719370 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.719707 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.720030 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.720348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.720668 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.720990 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.721317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.721625 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.721932 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.722234 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.722541 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.722843 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.723148 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.723453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.723753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.724053 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.724374 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.724676 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.724993 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.725327 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.725633 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.726296 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.726646 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.726991 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.727331 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.727630 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.727949 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.728268 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.728907 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.729235 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.729559 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.729876 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.730187 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.730500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.730810 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.731122 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.731434 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.731746 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.732058 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.732367 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.732860 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.733042 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.733584 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.733912 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.734223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.734535 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.734846 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.735298 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.735470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.735779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.736087 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.736392 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.736685 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.737012 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.737405 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.737732 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.738066 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.738383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.738696 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.739008 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.739319 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.739677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.739990 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.740294 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.740605 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.740918 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.741252 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.741560 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.741868 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.742177 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.742552 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.742923 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.743255 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.743566 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.743878 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.744201 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.744530 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.744847 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.745157 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.745493 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.745805 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.746337 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.746654 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.746986 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.747310 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.747636 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.747955 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.748269 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.748598 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.748903 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.749228 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.749542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.749934 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.750164 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.750482 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.750831 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.751132 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.751447 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.751753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.752296 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.752649 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.752964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.753292 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.753634 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.753972 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.754307 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.754617 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.754915 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.755216 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.755529 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.755836 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.756138 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.756439 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.756745 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.757050 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.757412 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.757559 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.context [None req-6e82ea9e-5069-4166-a78c-6fa9969b7f01 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bda7c23a-ff4f-46ad-9b00-aa25962dbf72(cell1) {{(pid=117552) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 17:21:40.757762 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.758157 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.758568 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.758874 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.759178 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.759483 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.759794 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.760097 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.760399 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.760702 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.761008 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.761342 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.761647 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.761755 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6e82ea9e-5069-4166-a78c-6fa9969b7f01 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:21:40.761955 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.762257 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.762568 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.762869 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.763174 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.763385 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6e82ea9e-5069-4166-a78c-6fa9969b7f01 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:21:40.763526 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.763846 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.764118 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6e82ea9e-5069-4166-a78c-6fa9969b7f01 None None] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:21:40.764254 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.764440 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.764756 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.765063 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.765409 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.765719 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.766027 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.766122 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6e82ea9e-5069-4166-a78c-6fa9969b7f01 None None] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:21:40.766374 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.766690 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.767244 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.767577 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.767896 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.768104 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO dbcounter [None req-6e82ea9e-5069-4166-a78c-6fa9969b7f01 None None] Registered counter for database nova_cell0 Jun 16 17:21:40.768381 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.768536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.768835 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.769140 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.769470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.769791 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.770101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.770710 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.771035 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.771344 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.771653 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.771961 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.772064 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO dbcounter [None req-6e82ea9e-5069-4166-a78c-6fa9969b7f01 None None] Registered counter for database nova_cell1 Jun 16 17:21:40.772276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.772585 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.772892 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.773220 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.773582 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.773915 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.774457 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.774822 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.775165 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.775483 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.775798 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.776113 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.776427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.776838 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.777042 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.777378 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.777683 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.778001 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.778334 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.778648 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.778956 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.779387 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.779695 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.779876 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_db.sqlalchemy.engines [None req-6e82ea9e-5069-4166-a78c-6fa9969b7f01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:21:40.780301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.780687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.781139 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.781366 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.781689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.782005 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.782246 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_db.sqlalchemy.engines [None req-6e82ea9e-5069-4166-a78c-6fa9969b7f01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:21:40.782441 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.782627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.782954 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.783342 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.783626 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.783950 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.784327 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.784550 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.784852 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.785161 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.785500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.785811 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.786111 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.786413 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.786720 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.787020 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.787322 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.787623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.787768 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writer thread running {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:21:40.787926 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.788232 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.788532 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.788831 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.789106 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writer thread running {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:21:40.789283 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.789559 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.789767 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.790215 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.790711 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.791076 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.791382 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.791687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.791993 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.792301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.792632 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.792963 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.793303 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.793626 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.793936 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.794254 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.794560 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.794879 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.795196 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.795511 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.795817 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.796154 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.796455 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.796762 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.797072 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.797407 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.797715 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.798027 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.798358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.798804 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.798983 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.799306 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.799622 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.799939 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.800252 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.800562 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.800889 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.801217 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.801533 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.801846 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.802161 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.802473 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.802787 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.803101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.803426 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.803749 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.804146 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.804473 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.804982 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.805251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.805568 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.805910 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.806238 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.806552 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.806858 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.807160 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:21:40.807405 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:21:40.870372 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO dbcounter [None req-ef841fca-8bc4-4e80-8bf1-2ff72b52d7ad None None] Registered counter for database nova_api Jun 16 17:21:40.891028 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_db.sqlalchemy.engines [None req-ef841fca-8bc4-4e80-8bf1-2ff72b52d7ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:21:40.898212 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writer thread running {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:21:40.936286 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO dbcounter [None req-6e82ea9e-5069-4166-a78c-6fa9969b7f01 None None] Registered counter for database nova_cell0 Jun 16 17:21:40.948164 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_db.sqlalchemy.engines [None req-6e82ea9e-5069-4166-a78c-6fa9969b7f01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:21:40.953446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writer thread running {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:21:40.957574 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.context [None req-ef841fca-8bc4-4e80-8bf1-2ff72b52d7ad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bda7c23a-ff4f-46ad-9b00-aa25962dbf72(cell1) {{(pid=117553) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 17:21:40.962441 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ef841fca-8bc4-4e80-8bf1-2ff72b52d7ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:21:40.964549 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ef841fca-8bc4-4e80-8bf1-2ff72b52d7ad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:21:40.965431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ef841fca-8bc4-4e80-8bf1-2ff72b52d7ad None None] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:21:40.967444 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ef841fca-8bc4-4e80-8bf1-2ff72b52d7ad None None] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:21:40.969508 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO dbcounter [None req-ef841fca-8bc4-4e80-8bf1-2ff72b52d7ad None None] Registered counter for database nova_cell0 Jun 16 17:21:40.974018 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO dbcounter [None req-ef841fca-8bc4-4e80-8bf1-2ff72b52d7ad None None] Registered counter for database nova_cell1 Jun 16 17:21:40.983018 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_db.sqlalchemy.engines [None req-ef841fca-8bc4-4e80-8bf1-2ff72b52d7ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:21:40.984413 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_db.sqlalchemy.engines [None req-ef841fca-8bc4-4e80-8bf1-2ff72b52d7ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:21:40.990713 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writer thread running {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:21:40.996200 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writer thread running {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:21:41.150089 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO dbcounter [None req-ef841fca-8bc4-4e80-8bf1-2ff72b52d7ad None None] Registered counter for database nova_cell0 Jun 16 17:21:41.158020 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_db.sqlalchemy.engines [None req-ef841fca-8bc4-4e80-8bf1-2ff72b52d7ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:21:41.162546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writer thread running {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:21:41.301396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: WARNING keystonemiddleware.auth_token [None req-6e82ea9e-5069-4166-a78c-6fa9969b7f01 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:21:41.309609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: WARNING keystonemiddleware.auth_token [None req-6e82ea9e-5069-4166-a78c-6fa9969b7f01 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:21:41.482958 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: WARNING keystonemiddleware.auth_token [None req-ef841fca-8bc4-4e80-8bf1-2ff72b52d7ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:21:41.490704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: WARNING keystonemiddleware.auth_token [None req-ef841fca-8bc4-4e80-8bf1-2ff72b52d7ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:21:41.675526 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: WARNING keystonemiddleware.auth_token [None req-6e82ea9e-5069-4166-a78c-6fa9969b7f01 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:21:41.684396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: WARNING keystonemiddleware.auth_token [None req-6e82ea9e-5069-4166-a78c-6fa9969b7f01 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:21:41.690288 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f3614ae9c0 pid: 117552 (default app) Jun 16 17:21:41.835785 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: WARNING keystonemiddleware.auth_token [None req-ef841fca-8bc4-4e80-8bf1-2ff72b52d7ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:21:41.842082 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: WARNING keystonemiddleware.auth_token [None req-ef841fca-8bc4-4e80-8bf1-2ff72b52d7ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:21:41.847503 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f3614ae9c0 pid: 117553 (default app) Jun 16 17:22:35.620147 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=3 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:22:35.623757 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=3 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:22:35.628490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=3 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:22:35.630946 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=3 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:22:35.834191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=3 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:22:35.835398 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=3 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:22:35.836210 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=3 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:22:35.837722 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=3 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:22:38.081797 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e8448b2b-c387-4816-a635-4cd354ee8aa2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-406936743", "imageRef": "c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:22:38.113042 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b55ede11-ea2c-4dbb-88ea-324863f26cc8 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-578727280", "imageRef": "c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1", "flavorRef": "452", "networks": [{"uuid": "cccb02cd-ffcd-4f18-9410-1ede3b2101bc"}]}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:22:40.019410 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.network.neutron [None req-e8448b2b-c387-4816-a635-4cd354ee8aa2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] validate_networks() for [('7c13538c-2941-4763-a560-37a0a33d14c7', None, None, None, None, None)] {{(pid=117552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:22:40.175899 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.network.neutron [None req-b55ede11-ea2c-4dbb-88ea-324863f26cc8 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] validate_networks() for [('cccb02cd-ffcd-4f18-9410-1ede3b2101bc', None, None, None, None, None)] {{(pid=117553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:22:42.209142 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-b55ede11-ea2c-4dbb-88ea-324863f26cc8 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Flavor limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:22:42.209789 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-b55ede11-ea2c-4dbb-88ea-324863f26cc8 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Image limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:22:42.210204 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-b55ede11-ea2c-4dbb-88ea-324863f26cc8 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Flavor pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:22:42.210616 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-b55ede11-ea2c-4dbb-88ea-324863f26cc8 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Image pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:22:42.211025 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-b55ede11-ea2c-4dbb-88ea-324863f26cc8 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:22:42.233532 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b55ede11-ea2c-4dbb-88ea-324863f26cc8 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:42.233979 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b55ede11-ea2c-4dbb-88ea-324863f26cc8 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:42.234878 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b55ede11-ea2c-4dbb-88ea-324863f26cc8 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:42.235310 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b55ede11-ea2c-4dbb-88ea-324863f26cc8 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:42.314240 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-b55ede11-ea2c-4dbb-88ea-324863f26cc8 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Getting quotas for project 859da351f9cc437ebe79e5bdb87a177d. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:22:42.341872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-b55ede11-ea2c-4dbb-88ea-324863f26cc8 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Getting quotas for user a132fd2fe24343239eafa8c46abaa2ed and project 859da351f9cc437ebe79e5bdb87a177d. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:22:42.343605 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-e8448b2b-c387-4816-a635-4cd354ee8aa2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Flavor limits 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:22:42.344022 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-e8448b2b-c387-4816-a635-4cd354ee8aa2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Image limits 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:22:42.344497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-e8448b2b-c387-4816-a635-4cd354ee8aa2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Flavor pref 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:22:42.344896 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-e8448b2b-c387-4816-a635-4cd354ee8aa2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Image pref 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:22:42.345353 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-e8448b2b-c387-4816-a635-4cd354ee8aa2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:22:42.365058 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-b55ede11-ea2c-4dbb-88ea-324863f26cc8 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Going to run 1 instances... {{(pid=117553) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:22:42.368667 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-b55ede11-ea2c-4dbb-88ea-324863f26cc8 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:22:42.372581 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e8448b2b-c387-4816-a635-4cd354ee8aa2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:42.377517 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e8448b2b-c387-4816-a635-4cd354ee8aa2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:42.378845 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e8448b2b-c387-4816-a635-4cd354ee8aa2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:42.384427 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e8448b2b-c387-4816-a635-4cd354ee8aa2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:42.458613 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-e8448b2b-c387-4816-a635-4cd354ee8aa2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Getting quotas for project ccf5c45783454fc5a7872490196f07e0. Resources: {'cores', 'instances', 'ram'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:22:42.480742 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-e8448b2b-c387-4816-a635-4cd354ee8aa2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Getting quotas for user 0cd8a309f6914d83b8e72bc60a5d7924 and project ccf5c45783454fc5a7872490196f07e0. Resources: {'cores', 'instances', 'ram'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:22:42.513475 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e8448b2b-c387-4816-a635-4cd354ee8aa2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Going to run 1 instances... {{(pid=117552) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:22:42.516529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e8448b2b-c387-4816-a635-4cd354ee8aa2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:22:42.519465 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b55ede11-ea2c-4dbb-88ea-324863f26cc8 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.695424 Jun 16 17:22:42.521692 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 1/1] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:22:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 6698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:22:42.814871 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-e8448b2b-c387-4816-a635-4cd354ee8aa2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.221206 Jun 16 17:22:42.816065 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 1/2] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:22:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 7225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:22:43.338223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-3c3660cc-06d5-4d46-be7e-7f33cc69aad0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Action: 'create', calling method: .version_select at 0x7f66b2c735e0>, body: {"keypair": {"name": "tempest-keypair-969411101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyX/c+bcOSrB4He1boEiAwY+YCkBOQjx187NIbkYlqZL3Hicce2zP71lE+F+wQnxpPkygjBmQhR8XgKPeIqTLM+3ywHhrtN7ErbGt/jD3GTSdCiXhkbcBJ+ww0OLptTAw=="}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:22:43.442868 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-3c3660cc-06d5-4d46-be7e-7f33cc69aad0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Getting quotas for project f029a8bb389c4d348c0e9001c5fa059c. Resources: {'key_pairs'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:22:43.468120 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-3c3660cc-06d5-4d46-be7e-7f33cc69aad0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Getting quotas for user 1a3418bd5d7f430ca84efd5c83e38fed and project f029a8bb389c4d348c0e9001c5fa059c. Resources: {'key_pairs'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:22:43.535718 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e3e90123-57b2-4b7d-a369-0a096801bbc7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Action: 'create', calling method: .version_select at 0x7f66b2c715e0>, body: {"keypair": {"name": "tempest-keypair-902250", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpdYct6TAKb8SXIlQ/I/K+cJmvJeWLjYdap89ePpqcwMEEH2tfGTu+K9bspKX2cVfM5QyvmPuLuV5t+0jNpey70NlawDBRa59+V/1u6UAbnAtmMzuaVUOBdPOpAcosKuA=="}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:22:43.651806 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-3c3660cc-06d5-4d46-be7e-7f33cc69aad0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.128590 Jun 16 17:22:43.657860 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 2/3] 10.222.0.66 () {60 vars in 1158 bytes} [Thu Jun 16 17:22:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:22:43.669983 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-e3e90123-57b2-4b7d-a369-0a096801bbc7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Getting quotas for project 0c63f648631a4a11910b4b135f22b235. Resources: {'key_pairs'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:22:43.678339 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a13188b5-e597-48ef-88a6-1abf0e19c6a9 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:43.679311 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a13188b5-e597-48ef-88a6-1abf0e19c6a9 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:43.698462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-e3e90123-57b2-4b7d-a369-0a096801bbc7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Getting quotas for user 68da2fd51cc84b2b8d641e1e6ac17c72 and project 0c63f648631a4a11910b4b135f22b235. Resources: {'key_pairs'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:22:43.882028 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-e3e90123-57b2-4b7d-a369-0a096801bbc7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 397 microversion: 2.20 time: 1.055072 Jun 16 17:22:43.893299 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 2/4] 10.222.0.66 () {62 vars in 1199 bytes} [Thu Jun 16 17:22:42 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1076 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 17:22:43.917852 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a13188b5-e597-48ef-88a6-1abf0e19c6a9 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:43.920198 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9977ea0b-85ee-4271-9d49-471d4638edb1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:43.921097 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-9977ea0b-85ee-4271-9d49-471d4638edb1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:43.945807 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a13188b5-e597-48ef-88a6-1abf0e19c6a9 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1214 microversion: 2.1 time: 0.285568 Jun 16 17:22:43.972491 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 3/5] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:43 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1214 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:44.371303 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9977ea0b-85ee-4271-9d49-471d4638edb1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:44.418422 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9977ea0b-85ee-4271-9d49-471d4638edb1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1221 microversion: 2.1 time: 0.523587 Jun 16 17:22:44.427026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 3/6] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:43 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1221 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:44.739712 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c7f702f7-351f-4acc-99d9-42c4e2d9858d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-97106919", "imageRef": "c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:22:44.923793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.network.neutron [None req-c7f702f7-351f-4acc-99d9-42c4e2d9858d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] validate_networks() for [('7c13538c-2941-4763-a560-37a0a33d14c7', None, None, None, None, None)] {{(pid=117553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:22:44.977703 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-965c3355-e4be-44cd-b362-b566f1ccb5cf tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:44.979655 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-965c3355-e4be-44cd-b362-b566f1ccb5cf tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:45.289659 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-965c3355-e4be-44cd-b362-b566f1ccb5cf tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:45.317620 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-965c3355-e4be-44cd-b362-b566f1ccb5cf tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1214 microversion: 2.1 time: 0.344359 Jun 16 17:22:45.322367 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 4/7] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:44 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1214 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:46.038134 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-c7f702f7-351f-4acc-99d9-42c4e2d9858d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Flavor limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:22:46.039292 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-c7f702f7-351f-4acc-99d9-42c4e2d9858d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Image limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:22:46.040295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-c7f702f7-351f-4acc-99d9-42c4e2d9858d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Flavor pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:22:46.040898 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-c7f702f7-351f-4acc-99d9-42c4e2d9858d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Image pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:22:46.042976 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-c7f702f7-351f-4acc-99d9-42c4e2d9858d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:22:46.060953 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c7f702f7-351f-4acc-99d9-42c4e2d9858d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:46.063871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c7f702f7-351f-4acc-99d9-42c4e2d9858d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:46.066261 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c7f702f7-351f-4acc-99d9-42c4e2d9858d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:46.069412 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c7f702f7-351f-4acc-99d9-42c4e2d9858d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:46.123962 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-c7f702f7-351f-4acc-99d9-42c4e2d9858d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Getting quotas for project ccf5c45783454fc5a7872490196f07e0. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:22:46.129155 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-c7f702f7-351f-4acc-99d9-42c4e2d9858d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Getting quotas for user 0cd8a309f6914d83b8e72bc60a5d7924 and project ccf5c45783454fc5a7872490196f07e0. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:22:46.156278 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c7f702f7-351f-4acc-99d9-42c4e2d9858d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Going to run 1 instances... {{(pid=117553) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:22:46.159776 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c7f702f7-351f-4acc-99d9-42c4e2d9858d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:22:46.278900 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c7f702f7-351f-4acc-99d9-42c4e2d9858d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.543872 Jun 16 17:22:46.291799 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 4/8] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:22:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:22:46.296073 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e9db9281-73a6-4128-a8e8-e8f0885fdaff tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:46.298219 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e9db9281-73a6-4128-a8e8-e8f0885fdaff tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:46.338335 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-bc1a787b-355f-45d2-b14c-bc59c1008691 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:46.339378 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-bc1a787b-355f-45d2-b14c-bc59c1008691 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:46.501826 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-bc1a787b-355f-45d2-b14c-bc59c1008691 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:46.511010 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-bc1a787b-355f-45d2-b14c-bc59c1008691 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1214 microversion: 2.1 time: 0.176559 Jun 16 17:22:46.517594 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 5/9] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:46 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:22:47.123038 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-e9db9281-73a6-4128-a8e8-e8f0885fdaff tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:47.153414 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-e9db9281-73a6-4128-a8e8-e8f0885fdaff tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1220 microversion: 2.1 time: 0.854790 Jun 16 17:22:47.156448 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 5/10] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:46 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1220 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:22:47.534059 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a1264291-263b-482d-bad7-28e66c954da4 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:47.534646 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a1264291-263b-482d-bad7-28e66c954da4 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:47.574906 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a1264291-263b-482d-bad7-28e66c954da4 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:47.575613 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a1264291-263b-482d-bad7-28e66c954da4 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:47.578719 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a1264291-263b-482d-bad7-28e66c954da4 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:47.578719 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a1264291-263b-482d-bad7-28e66c954da4 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:48.181776 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8908c16e-7bd3-4266-841a-3dbf40ff977f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:48.189136 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8908c16e-7bd3-4266-841a-3dbf40ff977f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:48.229581 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8908c16e-7bd3-4266-841a-3dbf40ff977f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:48.230089 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8908c16e-7bd3-4266-841a-3dbf40ff977f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:48.233577 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a1264291-263b-482d-bad7-28e66c954da4 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:48.237653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8908c16e-7bd3-4266-841a-3dbf40ff977f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:48.238125 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8908c16e-7bd3-4266-841a-3dbf40ff977f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:48.267716 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a1264291-263b-482d-bad7-28e66c954da4 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1266 microversion: 2.1 time: 0.734650 Jun 16 17:22:48.268469 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 6/11] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:47 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1266 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:48.884633 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8908c16e-7bd3-4266-841a-3dbf40ff977f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:48.902522 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8908c16e-7bd3-4266-841a-3dbf40ff977f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1216 microversion: 2.1 time: 0.731925 Jun 16 17:22:48.914717 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 6/12] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:48 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1216 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:49.286382 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-024ab29b-cc71-4503-8dad-2dadc89a1e23 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:49.287016 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-024ab29b-cc71-4503-8dad-2dadc89a1e23 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:49.312089 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-024ab29b-cc71-4503-8dad-2dadc89a1e23 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:49.312607 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-024ab29b-cc71-4503-8dad-2dadc89a1e23 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:49.314629 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-024ab29b-cc71-4503-8dad-2dadc89a1e23 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:49.315081 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-024ab29b-cc71-4503-8dad-2dadc89a1e23 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:49.513827 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-024ab29b-cc71-4503-8dad-2dadc89a1e23 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:49.525789 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-024ab29b-cc71-4503-8dad-2dadc89a1e23 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1274 microversion: 2.1 time: 0.244788 Jun 16 17:22:49.530530 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 7/13] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:49 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1274 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:49.566766 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c17d1fb6-d773-4900-8e27-5c5a8d0a6dd7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1459640638", "imageRef": "c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04f2ecf4-cd9f-483b-9100-6d9d67a561d2"}], "security_groups": [{"name": "tempest-securitygroup--1001719491"}], "key_name": "tempest-keypair-902250", "user_data": "}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:22:49.719903 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.network.neutron [None req-c17d1fb6-d773-4900-8e27-5c5a8d0a6dd7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] validate_networks() for [('04f2ecf4-cd9f-483b-9100-6d9d67a561d2', None, None, None, None, None)] {{(pid=117552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:22:49.932133 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5cedd061-8a10-427a-8f79-9a637ff256fe tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:49.932767 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5cedd061-8a10-427a-8f79-9a637ff256fe tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:49.955178 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5cedd061-8a10-427a-8f79-9a637ff256fe tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:49.956128 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5cedd061-8a10-427a-8f79-9a637ff256fe tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:49.961032 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5cedd061-8a10-427a-8f79-9a637ff256fe tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:49.963486 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5cedd061-8a10-427a-8f79-9a637ff256fe tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:50.046521 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-5cedd061-8a10-427a-8f79-9a637ff256fe tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:50.054568 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5cedd061-8a10-427a-8f79-9a637ff256fe tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1272 microversion: 2.1 time: 0.127204 Jun 16 17:22:50.064763 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 8/14] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:49 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:50.070376 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-dfcf68ed-df61-459c-9915-4114a6965a7c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-928401395", "imageRef": "c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82c6c893-96f4-45ae-b1e3-d70ff1db738d"}], "security_groups": [{"name": "tempest-securitygroup--1986269765"}], "key_name": "tempest-keypair-969411101", "user_data": "}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:22:50.235356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.network.neutron [None req-dfcf68ed-df61-459c-9915-4114a6965a7c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] validate_networks() for [('82c6c893-96f4-45ae-b1e3-d70ff1db738d', None, None, None, None, None)] {{(pid=117553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:22:50.453677 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-c17d1fb6-d773-4900-8e27-5c5a8d0a6dd7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Flavor limits 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:22:50.455490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-c17d1fb6-d773-4900-8e27-5c5a8d0a6dd7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Image limits 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:22:50.456607 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-c17d1fb6-d773-4900-8e27-5c5a8d0a6dd7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Flavor pref 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:22:50.457574 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-c17d1fb6-d773-4900-8e27-5c5a8d0a6dd7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Image pref 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:22:50.458862 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-c17d1fb6-d773-4900-8e27-5c5a8d0a6dd7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:22:50.476432 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c17d1fb6-d773-4900-8e27-5c5a8d0a6dd7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:50.477684 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c17d1fb6-d773-4900-8e27-5c5a8d0a6dd7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:50.479625 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c17d1fb6-d773-4900-8e27-5c5a8d0a6dd7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:50.480769 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c17d1fb6-d773-4900-8e27-5c5a8d0a6dd7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:50.512813 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-c17d1fb6-d773-4900-8e27-5c5a8d0a6dd7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Getting quotas for project 0c63f648631a4a11910b4b135f22b235. Resources: {'cores', 'instances', 'ram'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:22:50.521790 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-c17d1fb6-d773-4900-8e27-5c5a8d0a6dd7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Getting quotas for user 68da2fd51cc84b2b8d641e1e6ac17c72 and project 0c63f648631a4a11910b4b135f22b235. Resources: {'cores', 'instances', 'ram'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:22:50.532329 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c17d1fb6-d773-4900-8e27-5c5a8d0a6dd7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Going to run 1 instances... {{(pid=117552) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:22:50.540947 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c17d1fb6-d773-4900-8e27-5c5a8d0a6dd7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:22:50.599810 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c17d1fb6-d773-4900-8e27-5c5a8d0a6dd7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.037712 Jun 16 17:22:50.608563 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 7/15] 10.222.0.66 () {62 vars in 1187 bytes} [Thu Jun 16 17:22:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 17:22:50.620213 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a1e33756-86c0-4947-8cb0-f3bccbd3d58d tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:50.621829 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a1e33756-86c0-4947-8cb0-f3bccbd3d58d tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:50.652201 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a1e33756-86c0-4947-8cb0-f3bccbd3d58d tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:50.656816 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a1e33756-86c0-4947-8cb0-f3bccbd3d58d tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:50.662496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a1e33756-86c0-4947-8cb0-f3bccbd3d58d tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:50.666276 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a1e33756-86c0-4947-8cb0-f3bccbd3d58d tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:50.808521 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a1e33756-86c0-4947-8cb0-f3bccbd3d58d tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:50.822062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a1e33756-86c0-4947-8cb0-f3bccbd3d58d tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1274 microversion: 2.1 time: 0.207420 Jun 16 17:22:50.822802 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 8/16] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:50 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1274 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:50.834389 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9e2f6811-6159-4ccd-a005-344ac614d693 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:50.835171 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-9e2f6811-6159-4ccd-a005-344ac614d693 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:50.848863 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-dfcf68ed-df61-459c-9915-4114a6965a7c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Flavor limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:22:50.849506 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-dfcf68ed-df61-459c-9915-4114a6965a7c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Image limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:22:50.849951 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-dfcf68ed-df61-459c-9915-4114a6965a7c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Flavor pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:22:50.850494 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-dfcf68ed-df61-459c-9915-4114a6965a7c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Image pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:22:50.850915 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-dfcf68ed-df61-459c-9915-4114a6965a7c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:22:50.866569 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-dfcf68ed-df61-459c-9915-4114a6965a7c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:50.869029 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-dfcf68ed-df61-459c-9915-4114a6965a7c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:50.870037 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-dfcf68ed-df61-459c-9915-4114a6965a7c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:50.873525 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-dfcf68ed-df61-459c-9915-4114a6965a7c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:50.910942 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-dfcf68ed-df61-459c-9915-4114a6965a7c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Getting quotas for project f029a8bb389c4d348c0e9001c5fa059c. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:22:50.916785 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-dfcf68ed-df61-459c-9915-4114a6965a7c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Getting quotas for user 1a3418bd5d7f430ca84efd5c83e38fed and project f029a8bb389c4d348c0e9001c5fa059c. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:22:50.918203 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9e2f6811-6159-4ccd-a005-344ac614d693 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:50.927696 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9e2f6811-6159-4ccd-a005-344ac614d693 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:50.929922 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9e2f6811-6159-4ccd-a005-344ac614d693 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:50.931873 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9e2f6811-6159-4ccd-a005-344ac614d693 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1278 microversion: 2.20 time: 0.105423 Jun 16 17:22:50.932894 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 9/17] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:22:50 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1278 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:22:50.939247 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-dfcf68ed-df61-459c-9915-4114a6965a7c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Going to run 1 instances... {{(pid=117553) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:22:50.949750 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-dfcf68ed-df61-459c-9915-4114a6965a7c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:22:51.040525 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-dfcf68ed-df61-459c-9915-4114a6965a7c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.973987 Jun 16 17:22:51.042217 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 9/18] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:22:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:22:51.052731 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a5e4f32b-a5c8-410a-86a1-a706680e6eb6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:51.053396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a5e4f32b-a5c8-410a-86a1-a706680e6eb6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:51.072401 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-85db64c7-3e70-4ffe-bcef-a27e99827c18 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:51.073130 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-85db64c7-3e70-4ffe-bcef-a27e99827c18 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:51.103404 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-85db64c7-3e70-4ffe-bcef-a27e99827c18 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:51.109045 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-85db64c7-3e70-4ffe-bcef-a27e99827c18 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:51.110096 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-85db64c7-3e70-4ffe-bcef-a27e99827c18 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:51.110520 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-85db64c7-3e70-4ffe-bcef-a27e99827c18 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:51.197788 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a5e4f32b-a5c8-410a-86a1-a706680e6eb6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:51.222412 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a5e4f32b-a5c8-410a-86a1-a706680e6eb6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1236 microversion: 2.1 time: 0.173409 Jun 16 17:22:51.223549 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 10/19] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:51 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1236 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:51.342791 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-85db64c7-3e70-4ffe-bcef-a27e99827c18 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:51.365345 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-85db64c7-3e70-4ffe-bcef-a27e99827c18 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1272 microversion: 2.1 time: 0.296496 Jun 16 17:22:51.376844 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 10/20] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:51 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1272 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:22:51.840399 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8653f857-209f-4405-8e80-01b381710a85 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:51.841296 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8653f857-209f-4405-8e80-01b381710a85 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:51.861515 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8653f857-209f-4405-8e80-01b381710a85 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:51.867420 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8653f857-209f-4405-8e80-01b381710a85 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:51.870927 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8653f857-209f-4405-8e80-01b381710a85 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:51.873202 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8653f857-209f-4405-8e80-01b381710a85 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:51.953677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-df168808-3b26-46d4-a314-7e8ade333850 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:51.955282 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-df168808-3b26-46d4-a314-7e8ade333850 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:51.995607 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-df168808-3b26-46d4-a314-7e8ade333850 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:51.996341 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-df168808-3b26-46d4-a314-7e8ade333850 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:51.997164 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-df168808-3b26-46d4-a314-7e8ade333850 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:51.997620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-df168808-3b26-46d4-a314-7e8ade333850 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:52.324466 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-df168808-3b26-46d4-a314-7e8ade333850 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:52.341716 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-df168808-3b26-46d4-a314-7e8ade333850 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:52.350743 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-df168808-3b26-46d4-a314-7e8ade333850 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:52.357126 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-df168808-3b26-46d4-a314-7e8ade333850 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1274 microversion: 2.20 time: 0.408958 Jun 16 17:22:52.360058 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 11/21] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:22:51 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1274 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:22:52.374401 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-bbc50978-794f-4792-a4b3-2885e32c4f9f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:52.379534 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-bbc50978-794f-4792-a4b3-2885e32c4f9f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:52.402638 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bbc50978-794f-4792-a4b3-2885e32c4f9f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:52.403088 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bbc50978-794f-4792-a4b3-2885e32c4f9f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:52.408804 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bbc50978-794f-4792-a4b3-2885e32c4f9f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:52.409336 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bbc50978-794f-4792-a4b3-2885e32c4f9f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:52.447852 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8653f857-209f-4405-8e80-01b381710a85 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:52.469883 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8653f857-209f-4405-8e80-01b381710a85 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1284 microversion: 2.1 time: 0.630527 Jun 16 17:22:52.471274 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 11/22] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:51 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1284 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:22:52.506984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-6bb6007d-ac68-45e5-bbcd-b5b8c588a2fc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:52.512795 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-6bb6007d-ac68-45e5-bbcd-b5b8c588a2fc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:52.538470 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6bb6007d-ac68-45e5-bbcd-b5b8c588a2fc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:52.544977 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6bb6007d-ac68-45e5-bbcd-b5b8c588a2fc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:52.547455 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6bb6007d-ac68-45e5-bbcd-b5b8c588a2fc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:52.550453 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6bb6007d-ac68-45e5-bbcd-b5b8c588a2fc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:52.857798 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-bbc50978-794f-4792-a4b3-2885e32c4f9f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:52.873481 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-bbc50978-794f-4792-a4b3-2885e32c4f9f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1232 microversion: 2.1 time: 0.510419 Jun 16 17:22:52.875830 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 12/23] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:52 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1232 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:52.906510 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-6bb6007d-ac68-45e5-bbcd-b5b8c588a2fc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:52.919694 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-6bb6007d-ac68-45e5-bbcd-b5b8c588a2fc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1280 microversion: 2.1 time: 0.447053 Jun 16 17:22:52.923547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 12/24] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:52 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1280 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:53.386012 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-6f03dab1-e7a9-45f2-912e-8925f0b29371 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:53.386626 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-6f03dab1-e7a9-45f2-912e-8925f0b29371 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:53.415129 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6f03dab1-e7a9-45f2-912e-8925f0b29371 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:53.415973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6f03dab1-e7a9-45f2-912e-8925f0b29371 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:53.421517 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6f03dab1-e7a9-45f2-912e-8925f0b29371 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:53.424458 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6f03dab1-e7a9-45f2-912e-8925f0b29371 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:53.488302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d4dc34b6-9dc5-44c1-ac25-47c14761fbb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:53.489396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d4dc34b6-9dc5-44c1-ac25-47c14761fbb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:53.505536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d4dc34b6-9dc5-44c1-ac25-47c14761fbb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:53.505990 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d4dc34b6-9dc5-44c1-ac25-47c14761fbb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:53.517751 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d4dc34b6-9dc5-44c1-ac25-47c14761fbb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:53.518309 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d4dc34b6-9dc5-44c1-ac25-47c14761fbb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:53.787082 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6f03dab1-e7a9-45f2-912e-8925f0b29371 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:53.796275 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6f03dab1-e7a9-45f2-912e-8925f0b29371 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:53.825037 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6f03dab1-e7a9-45f2-912e-8925f0b29371 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:53.826427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-6f03dab1-e7a9-45f2-912e-8925f0b29371 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1338 microversion: 2.20 time: 0.444823 Jun 16 17:22:53.832567 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 13/25] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:22:53 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1338 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:22:53.895961 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5bf0de8a-0300-4038-b7ef-ec9c0b196d84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:53.896800 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5bf0de8a-0300-4038-b7ef-ec9c0b196d84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:53.921637 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5bf0de8a-0300-4038-b7ef-ec9c0b196d84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:53.922601 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5bf0de8a-0300-4038-b7ef-ec9c0b196d84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:53.923633 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5bf0de8a-0300-4038-b7ef-ec9c0b196d84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:53.928212 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5bf0de8a-0300-4038-b7ef-ec9c0b196d84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:54.244876 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-5bf0de8a-0300-4038-b7ef-ec9c0b196d84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:54.277073 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5bf0de8a-0300-4038-b7ef-ec9c0b196d84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1294 microversion: 2.1 time: 0.374623 Jun 16 17:22:54.278324 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 14/26] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:53 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1294 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:54.284336 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-48dc57bd-9846-43a7-8ede-9484878d5781 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:54.284946 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-48dc57bd-9846-43a7-8ede-9484878d5781 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:54.303199 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-48dc57bd-9846-43a7-8ede-9484878d5781 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:54.303709 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-48dc57bd-9846-43a7-8ede-9484878d5781 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:54.315282 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d4dc34b6-9dc5-44c1-ac25-47c14761fbb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:54.320719 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-48dc57bd-9846-43a7-8ede-9484878d5781 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:54.321169 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-48dc57bd-9846-43a7-8ede-9484878d5781 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:54.342078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d4dc34b6-9dc5-44c1-ac25-47c14761fbb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1272 microversion: 2.1 time: 0.856239 Jun 16 17:22:54.347472 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 13/27] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:53 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1272 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:22:54.848993 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ca6fbaf1-9e61-4e6e-a579-1f9d3beefea6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:54.849911 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ca6fbaf1-9e61-4e6e-a579-1f9d3beefea6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:54.862402 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ca6fbaf1-9e61-4e6e-a579-1f9d3beefea6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:54.863027 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ca6fbaf1-9e61-4e6e-a579-1f9d3beefea6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:54.867040 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ca6fbaf1-9e61-4e6e-a579-1f9d3beefea6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:54.868648 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ca6fbaf1-9e61-4e6e-a579-1f9d3beefea6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:54.944613 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ca6fbaf1-9e61-4e6e-a579-1f9d3beefea6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:54.976863 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ca6fbaf1-9e61-4e6e-a579-1f9d3beefea6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:54.981326 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ca6fbaf1-9e61-4e6e-a579-1f9d3beefea6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:54.982917 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ca6fbaf1-9e61-4e6e-a579-1f9d3beefea6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1336 microversion: 2.20 time: 0.138187 Jun 16 17:22:54.994400 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 14/28] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:22:54 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1336 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:22:54.994720 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-48dc57bd-9846-43a7-8ede-9484878d5781 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:55.001079 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-48dc57bd-9846-43a7-8ede-9484878d5781 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1278 microversion: 2.1 time: 0.721527 Jun 16 17:22:55.009260 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 15/29] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:54 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1278 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:55.295534 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9cdfda11-19b8-4e53-9c0f-394b1ce9600a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:55.296673 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-9cdfda11-19b8-4e53-9c0f-394b1ce9600a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:55.312706 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9cdfda11-19b8-4e53-9c0f-394b1ce9600a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:55.314160 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9cdfda11-19b8-4e53-9c0f-394b1ce9600a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:55.317200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9cdfda11-19b8-4e53-9c0f-394b1ce9600a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:55.320071 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9cdfda11-19b8-4e53-9c0f-394b1ce9600a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:55.370644 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d38471b3-75cf-40f6-9db8-c3be9e3ea858 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:55.371585 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-d38471b3-75cf-40f6-9db8-c3be9e3ea858 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:55.379149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d38471b3-75cf-40f6-9db8-c3be9e3ea858 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:55.380812 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d38471b3-75cf-40f6-9db8-c3be9e3ea858 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:55.381841 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d38471b3-75cf-40f6-9db8-c3be9e3ea858 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:55.383100 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d38471b3-75cf-40f6-9db8-c3be9e3ea858 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:55.439054 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9cdfda11-19b8-4e53-9c0f-394b1ce9600a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:55.451591 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9cdfda11-19b8-4e53-9c0f-394b1ce9600a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1294 microversion: 2.1 time: 0.160244 Jun 16 17:22:55.452163 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 15/30] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:55 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1294 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:55.934023 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d38471b3-75cf-40f6-9db8-c3be9e3ea858 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:55.951071 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-d38471b3-75cf-40f6-9db8-c3be9e3ea858 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 0.585992 Jun 16 17:22:55.954382 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 16/31] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:55 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:22:56.001672 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-323e45c6-8225-41af-a92b-5f71048ec932 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:56.002656 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-323e45c6-8225-41af-a92b-5f71048ec932 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:56.009470 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-323e45c6-8225-41af-a92b-5f71048ec932 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:56.014262 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-323e45c6-8225-41af-a92b-5f71048ec932 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:56.015131 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-323e45c6-8225-41af-a92b-5f71048ec932 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:56.015570 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-323e45c6-8225-41af-a92b-5f71048ec932 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:56.024797 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-08eee795-0dfb-45c4-9dad-7728c3006a62 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:56.026902 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-08eee795-0dfb-45c4-9dad-7728c3006a62 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:56.035899 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-08eee795-0dfb-45c4-9dad-7728c3006a62 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:56.036815 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-08eee795-0dfb-45c4-9dad-7728c3006a62 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:56.038389 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-08eee795-0dfb-45c4-9dad-7728c3006a62 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:56.040036 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-08eee795-0dfb-45c4-9dad-7728c3006a62 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:56.160053 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-323e45c6-8225-41af-a92b-5f71048ec932 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:56.174021 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-08eee795-0dfb-45c4-9dad-7728c3006a62 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:56.178853 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-323e45c6-8225-41af-a92b-5f71048ec932 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:56.183224 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-323e45c6-8225-41af-a92b-5f71048ec932 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:56.186711 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-08eee795-0dfb-45c4-9dad-7728c3006a62 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1278 microversion: 2.1 time: 0.169493 Jun 16 17:22:56.189092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-323e45c6-8225-41af-a92b-5f71048ec932 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1336 microversion: 2.20 time: 0.191251 Jun 16 17:22:56.189322 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 17/32] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:56 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:56.199687 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 16/33] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:22:55 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1336 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:22:56.469499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b222e773-e891-4ce8-ba25-6168caccb0e0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:56.475119 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-b222e773-e891-4ce8-ba25-6168caccb0e0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:56.483345 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b222e773-e891-4ce8-ba25-6168caccb0e0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:56.483841 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b222e773-e891-4ce8-ba25-6168caccb0e0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:56.484582 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b222e773-e891-4ce8-ba25-6168caccb0e0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:56.485015 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b222e773-e891-4ce8-ba25-6168caccb0e0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:56.648293 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b222e773-e891-4ce8-ba25-6168caccb0e0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:56.662787 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b222e773-e891-4ce8-ba25-6168caccb0e0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1294 microversion: 2.1 time: 0.197130 Jun 16 17:22:56.663365 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 18/34] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:56 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1294 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:56.987172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f58ac35c-075d-4dfa-a589-517081ad6586 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:56.987877 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f58ac35c-075d-4dfa-a589-517081ad6586 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:57.000671 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f58ac35c-075d-4dfa-a589-517081ad6586 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:57.004002 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f58ac35c-075d-4dfa-a589-517081ad6586 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:57.004913 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f58ac35c-075d-4dfa-a589-517081ad6586 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:57.006005 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f58ac35c-075d-4dfa-a589-517081ad6586 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:57.204138 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d55e900b-2960-47ec-83ce-2dedd5047440 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:57.204743 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-d55e900b-2960-47ec-83ce-2dedd5047440 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:57.214934 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d55e900b-2960-47ec-83ce-2dedd5047440 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:57.216141 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d55e900b-2960-47ec-83ce-2dedd5047440 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:57.218461 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d55e900b-2960-47ec-83ce-2dedd5047440 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:57.219804 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d55e900b-2960-47ec-83ce-2dedd5047440 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:57.287908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f58ac35c-075d-4dfa-a589-517081ad6586 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:57.302524 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f58ac35c-075d-4dfa-a589-517081ad6586 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 0.333185 Jun 16 17:22:57.313682 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 17/35] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:56 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:57.326015 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8f707597-0520-47a7-8896-17f6940f73e2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:57.326629 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8f707597-0520-47a7-8896-17f6940f73e2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:57.344584 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8f707597-0520-47a7-8896-17f6940f73e2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:57.345090 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8f707597-0520-47a7-8896-17f6940f73e2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:57.345933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8f707597-0520-47a7-8896-17f6940f73e2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:57.346372 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8f707597-0520-47a7-8896-17f6940f73e2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:57.497821 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d55e900b-2960-47ec-83ce-2dedd5047440 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:57.513248 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-d55e900b-2960-47ec-83ce-2dedd5047440 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 0.311887 Jun 16 17:22:57.515059 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 19/36] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:57 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:22:57.613223 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8f707597-0520-47a7-8896-17f6940f73e2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:57.639469 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8f707597-0520-47a7-8896-17f6940f73e2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:57.640973 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8f707597-0520-47a7-8896-17f6940f73e2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:57.645041 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8f707597-0520-47a7-8896-17f6940f73e2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1336 microversion: 2.20 time: 0.327412 Jun 16 17:22:57.646105 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 18/37] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:22:57 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1336 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:22:57.682470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-06c5455a-3ebb-46e9-a882-9a58335cb824 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:57.683191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-06c5455a-3ebb-46e9-a882-9a58335cb824 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:57.702795 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-06c5455a-3ebb-46e9-a882-9a58335cb824 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:57.704202 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-06c5455a-3ebb-46e9-a882-9a58335cb824 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:57.705612 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-06c5455a-3ebb-46e9-a882-9a58335cb824 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:57.706367 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-06c5455a-3ebb-46e9-a882-9a58335cb824 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:57.798132 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-06c5455a-3ebb-46e9-a882-9a58335cb824 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:57.811642 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-06c5455a-3ebb-46e9-a882-9a58335cb824 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1294 microversion: 2.1 time: 0.133873 Jun 16 17:22:57.812236 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 20/38] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:57 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1294 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:58.321082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-56e17b9e-3ffb-41e1-8313-c01641deb892 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:58.321874 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-56e17b9e-3ffb-41e1-8313-c01641deb892 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:58.351341 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-56e17b9e-3ffb-41e1-8313-c01641deb892 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:58.357867 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-56e17b9e-3ffb-41e1-8313-c01641deb892 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:58.363437 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-56e17b9e-3ffb-41e1-8313-c01641deb892 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:58.367734 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-56e17b9e-3ffb-41e1-8313-c01641deb892 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:58.531330 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-215f69b3-7660-429e-b622-57d47dc3e493 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:58.532066 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-215f69b3-7660-429e-b622-57d47dc3e493 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:58.546721 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:22:58.566780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-215f69b3-7660-429e-b622-57d47dc3e493 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:58.570618 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-215f69b3-7660-429e-b622-57d47dc3e493 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:58.574627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-215f69b3-7660-429e-b622-57d47dc3e493 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:58.578545 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-215f69b3-7660-429e-b622-57d47dc3e493 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:59.471443 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-56e17b9e-3ffb-41e1-8313-c01641deb892 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:59.487737 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-56e17b9e-3ffb-41e1-8313-c01641deb892 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 1.168962 Jun 16 17:22:59.491813 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 19/39] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:58 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:22:59.512599 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9c4fc1b0-68f8-45c5-9df8-7fdc1fa9d716 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:59.526112 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-9c4fc1b0-68f8-45c5-9df8-7fdc1fa9d716 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:59.554134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9c4fc1b0-68f8-45c5-9df8-7fdc1fa9d716 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:59.558060 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9c4fc1b0-68f8-45c5-9df8-7fdc1fa9d716 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:59.564643 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9c4fc1b0-68f8-45c5-9df8-7fdc1fa9d716 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:59.567556 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9c4fc1b0-68f8-45c5-9df8-7fdc1fa9d716 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:59.798235 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-215f69b3-7660-429e-b622-57d47dc3e493 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:22:59.814235 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-215f69b3-7660-429e-b622-57d47dc3e493 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 1.286759 Jun 16 17:22:59.814930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 21/40] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:58 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:22:59.828082 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-bef210fd-2e25-456e-84ce-3e8c4dc09a22 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:22:59.828082 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-bef210fd-2e25-456e-84ce-3e8c4dc09a22 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:22:59.858245 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bef210fd-2e25-456e-84ce-3e8c4dc09a22 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:59.865019 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bef210fd-2e25-456e-84ce-3e8c4dc09a22 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:59.866122 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bef210fd-2e25-456e-84ce-3e8c4dc09a22 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:22:59.866692 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bef210fd-2e25-456e-84ce-3e8c4dc09a22 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:22:59.935644 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=100 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:00.006006 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9c4fc1b0-68f8-45c5-9df8-7fdc1fa9d716 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:00.021777 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9c4fc1b0-68f8-45c5-9df8-7fdc1fa9d716 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:00.033278 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9c4fc1b0-68f8-45c5-9df8-7fdc1fa9d716 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:00.037966 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9c4fc1b0-68f8-45c5-9df8-7fdc1fa9d716 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1336 microversion: 2.20 time: 0.543844 Jun 16 17:23:00.040166 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 20/41] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:22:59 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1336 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:00.094423 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-bef210fd-2e25-456e-84ce-3e8c4dc09a22 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:00.127457 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-bef210fd-2e25-456e-84ce-3e8c4dc09a22 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1294 microversion: 2.1 time: 0.302502 Jun 16 17:23:00.132810 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 22/42] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:22:59 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1294 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:00.508665 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9e536006-a0a2-46a7-b163-9e855b8310d7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:00.510561 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-9e536006-a0a2-46a7-b163-9e855b8310d7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:00.520920 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=4 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:00.522923 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9e536006-a0a2-46a7-b163-9e855b8310d7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:00.540557 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9e536006-a0a2-46a7-b163-9e855b8310d7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:00.548381 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9e536006-a0a2-46a7-b163-9e855b8310d7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:00.548781 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9e536006-a0a2-46a7-b163-9e855b8310d7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:00.832234 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-fae8d3ef-1fc6-484a-98f9-f4ef325c62a5 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:00.832844 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-fae8d3ef-1fc6-484a-98f9-f4ef325c62a5 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:00.846534 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fae8d3ef-1fc6-484a-98f9-f4ef325c62a5 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:00.854897 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fae8d3ef-1fc6-484a-98f9-f4ef325c62a5 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:00.864325 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fae8d3ef-1fc6-484a-98f9-f4ef325c62a5 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:00.874270 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fae8d3ef-1fc6-484a-98f9-f4ef325c62a5 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:00.941995 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=6 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:00.948234 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=26 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:01.220857 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=26 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:01.715973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-fae8d3ef-1fc6-484a-98f9-f4ef325c62a5 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:01.725514 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-fae8d3ef-1fc6-484a-98f9-f4ef325c62a5 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 0.896956 Jun 16 17:23:01.729640 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 23/43] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:00 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:01.738263 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-6e5946ce-73d0-4dfe-b83f-7426d38c9458 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:01.738761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-6e5946ce-73d0-4dfe-b83f-7426d38c9458 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:01.779167 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6e5946ce-73d0-4dfe-b83f-7426d38c9458 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:01.779619 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6e5946ce-73d0-4dfe-b83f-7426d38c9458 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:01.780885 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6e5946ce-73d0-4dfe-b83f-7426d38c9458 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:01.780885 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6e5946ce-73d0-4dfe-b83f-7426d38c9458 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:02.336585 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6e5946ce-73d0-4dfe-b83f-7426d38c9458 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:02.369226 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6e5946ce-73d0-4dfe-b83f-7426d38c9458 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:02.372072 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6e5946ce-73d0-4dfe-b83f-7426d38c9458 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:02.395507 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-6e5946ce-73d0-4dfe-b83f-7426d38c9458 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.662415 Jun 16 17:23:02.408641 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 24/44] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:01 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:02.427297 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-530074fb-cf04-4550-8d8c-7e42bf21ea29 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:02.435621 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-530074fb-cf04-4550-8d8c-7e42bf21ea29 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:02.459009 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-530074fb-cf04-4550-8d8c-7e42bf21ea29 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:02.459494 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-530074fb-cf04-4550-8d8c-7e42bf21ea29 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:02.464156 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-530074fb-cf04-4550-8d8c-7e42bf21ea29 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:02.464632 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-530074fb-cf04-4550-8d8c-7e42bf21ea29 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:02.696365 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9e536006-a0a2-46a7-b163-9e855b8310d7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:02.724379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9e536006-a0a2-46a7-b163-9e855b8310d7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 2.206618 Jun 16 17:23:02.729502 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 21/45] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:00 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 2228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:03.293150 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-157a5345-9ac5-4966-ab09-e4f038fdd05e req-3e2d92dd-3ea0-4883-ae84-cb9bdea3240f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ea9630-ef03-47fd-aa60-695a36081c19", "tag": "6fa0a160-b8b9-480d-91ad-c84aa7d2485a"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:23:03.328365 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-157a5345-9ac5-4966-ab09-e4f038fdd05e req-3e2d92dd-3ea0-4883-ae84-cb9bdea3240f service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:03.328900 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-157a5345-9ac5-4966-ab09-e4f038fdd05e req-3e2d92dd-3ea0-4883-ae84-cb9bdea3240f service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:03.373595 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-157a5345-9ac5-4966-ab09-e4f038fdd05e req-3e2d92dd-3ea0-4883-ae84-cb9bdea3240f service nova] Creating event network-changed:6fa0a160-b8b9-480d-91ad-c84aa7d2485a for instance 90ea9630-ef03-47fd-aa60-695a36081c19 on hv-cinder-83735 Jun 16 17:23:03.374155 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-157a5345-9ac5-4966-ab09-e4f038fdd05e req-3e2d92dd-3ea0-4883-ae84-cb9bdea3240f service nova] Acquired lock "compute-rpcapi-router" {{(pid=117552) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 17:23:03.375312 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f5281510-5380-4da9-b4d2-15dfd3348a03 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:03.375746 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f5281510-5380-4da9-b4d2-15dfd3348a03 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:03.376531 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f5281510-5380-4da9-b4d2-15dfd3348a03 None None] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:03.376963 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f5281510-5380-4da9-b4d2-15dfd3348a03 None None] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:03.416763 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.compute.rpcapi [None req-f5281510-5380-4da9-b4d2-15dfd3348a03 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 17:23:03.418130 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f5281510-5380-4da9-b4d2-15dfd3348a03 None None] Releasing lock "compute-rpcapi-router" {{(pid=117552) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 17:23:03.476430 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f5281510-5380-4da9-b4d2-15dfd3348a03 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.739736 Jun 16 17:23:03.477367 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 22/46] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:23:03.498614 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-1aaa77a5-d33b-424e-9982-0ca2dbd2ed9c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:03.501143 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-1aaa77a5-d33b-424e-9982-0ca2dbd2ed9c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:03.522248 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1aaa77a5-d33b-424e-9982-0ca2dbd2ed9c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:03.522687 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1aaa77a5-d33b-424e-9982-0ca2dbd2ed9c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:03.529830 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1aaa77a5-d33b-424e-9982-0ca2dbd2ed9c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:03.530397 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1aaa77a5-d33b-424e-9982-0ca2dbd2ed9c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:04.240727 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-530074fb-cf04-4550-8d8c-7e42bf21ea29 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:04.256833 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-530074fb-cf04-4550-8d8c-7e42bf21ea29 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 1.846128 Jun 16 17:23:04.259589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 25/47] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:02 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:04.274329 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-da19b371-1d4c-4505-bacb-cffa38e9794d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:04.279585 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-da19b371-1d4c-4505-bacb-cffa38e9794d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:04.307689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-da19b371-1d4c-4505-bacb-cffa38e9794d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:04.308921 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-da19b371-1d4c-4505-bacb-cffa38e9794d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:04.313490 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-da19b371-1d4c-4505-bacb-cffa38e9794d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:04.315762 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-da19b371-1d4c-4505-bacb-cffa38e9794d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:05.321229 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-1aaa77a5-d33b-424e-9982-0ca2dbd2ed9c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:05.333159 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-1aaa77a5-d33b-424e-9982-0ca2dbd2ed9c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 1.854272 Jun 16 17:23:05.348086 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 23/48] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:03 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:05.361023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-98465a05-c5ed-4e53-bfa5-298ee4c69a6a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:05.362466 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-98465a05-c5ed-4e53-bfa5-298ee4c69a6a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:05.371410 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-98465a05-c5ed-4e53-bfa5-298ee4c69a6a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:05.372134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-98465a05-c5ed-4e53-bfa5-298ee4c69a6a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:05.373097 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-98465a05-c5ed-4e53-bfa5-298ee4c69a6a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:05.373770 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-98465a05-c5ed-4e53-bfa5-298ee4c69a6a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:05.798610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-da19b371-1d4c-4505-bacb-cffa38e9794d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:05.851431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-da19b371-1d4c-4505-bacb-cffa38e9794d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:05.856601 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-da19b371-1d4c-4505-bacb-cffa38e9794d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:05.886745 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-da19b371-1d4c-4505-bacb-cffa38e9794d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 1.623677 Jun 16 17:23:05.894113 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 26/49] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:04 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:06.232559 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-5203cb86-2c79-406d-a8a3-c20f926a526e req-7a44fa27-4c69-4b9f-bffe-0052c9e9457a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b787b3-74c7-4e30-9f10-acea71d19c0c", "tag": "793bfabc-d2dc-472c-95a2-270f46bad4dc"}, {"name": "network-changed", "server_uuid": "75957299-3d36-4f9c-a081-9e621c88225c", "tag": "24585d4c-eda6-469f-a310-d2d5f70274a1"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:23:06.262271 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-5203cb86-2c79-406d-a8a3-c20f926a526e req-7a44fa27-4c69-4b9f-bffe-0052c9e9457a service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:06.262736 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-5203cb86-2c79-406d-a8a3-c20f926a526e req-7a44fa27-4c69-4b9f-bffe-0052c9e9457a service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:06.377745 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-5203cb86-2c79-406d-a8a3-c20f926a526e req-7a44fa27-4c69-4b9f-bffe-0052c9e9457a service nova] Creating event network-changed:793bfabc-d2dc-472c-95a2-270f46bad4dc for instance 57b787b3-74c7-4e30-9f10-acea71d19c0c on hv-cinder-83735 Jun 16 17:23:06.378115 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-5203cb86-2c79-406d-a8a3-c20f926a526e req-7a44fa27-4c69-4b9f-bffe-0052c9e9457a service nova] Creating event network-changed:24585d4c-eda6-469f-a310-d2d5f70274a1 for instance 75957299-3d36-4f9c-a081-9e621c88225c on hv-cinder-83735 Jun 16 17:23:06.386610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-5203cb86-2c79-406d-a8a3-c20f926a526e req-7a44fa27-4c69-4b9f-bffe-0052c9e9457a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117553) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 17:23:06.387943 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a59259dc-bf29-4e6d-bd2e-4dcffc3c1ea4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:06.390628 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a59259dc-bf29-4e6d-bd2e-4dcffc3c1ea4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:06.392598 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a59259dc-bf29-4e6d-bd2e-4dcffc3c1ea4 None None] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:06.397817 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a59259dc-bf29-4e6d-bd2e-4dcffc3c1ea4 None None] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:06.418716 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.compute.rpcapi [None req-a59259dc-bf29-4e6d-bd2e-4dcffc3c1ea4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 17:23:06.420340 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a59259dc-bf29-4e6d-bd2e-4dcffc3c1ea4 None None] Releasing lock "compute-rpcapi-router" {{(pid=117553) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 17:23:06.471210 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a59259dc-bf29-4e6d-bd2e-4dcffc3c1ea4 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.574987 Jun 16 17:23:06.472636 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 27/50] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:23:06.479308 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5262dcf2-3902-496f-ac5b-203a17fbc623 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:06.481514 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5262dcf2-3902-496f-ac5b-203a17fbc623 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:06.490132 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5262dcf2-3902-496f-ac5b-203a17fbc623 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:06.492201 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5262dcf2-3902-496f-ac5b-203a17fbc623 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:06.497624 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5262dcf2-3902-496f-ac5b-203a17fbc623 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:06.499246 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5262dcf2-3902-496f-ac5b-203a17fbc623 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:06.580129 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-98465a05-c5ed-4e53-bfa5-298ee4c69a6a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:06.583581 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=97 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:06.603250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-98465a05-c5ed-4e53-bfa5-298ee4c69a6a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 1.264193 Jun 16 17:23:06.603811 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 24/51] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:05 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:06.608843 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ae1dfe4e-50bb-4e61-a089-0bf09efe7621 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:06.628901 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ae1dfe4e-50bb-4e61-a089-0bf09efe7621 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:06.631151 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:06.659976 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ae1dfe4e-50bb-4e61-a089-0bf09efe7621 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:06.660712 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ae1dfe4e-50bb-4e61-a089-0bf09efe7621 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:06.661724 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ae1dfe4e-50bb-4e61-a089-0bf09efe7621 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:06.662309 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ae1dfe4e-50bb-4e61-a089-0bf09efe7621 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:07.479117 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-5262dcf2-3902-496f-ac5b-203a17fbc623 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:07.480457 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ae1dfe4e-50bb-4e61-a089-0bf09efe7621 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:07.497215 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5262dcf2-3902-496f-ac5b-203a17fbc623 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 1.022921 Jun 16 17:23:07.506540 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 28/52] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:06 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:07.512091 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ae1dfe4e-50bb-4e61-a089-0bf09efe7621 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 0.907125 Jun 16 17:23:07.512987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7bdb1882-dbf5-4a75-b0ca-d900ad3abc15 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:07.513634 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-7bdb1882-dbf5-4a75-b0ca-d900ad3abc15 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:07.523112 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 25/53] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:06 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:07.539212 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7bdb1882-dbf5-4a75-b0ca-d900ad3abc15 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:07.539791 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7bdb1882-dbf5-4a75-b0ca-d900ad3abc15 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:07.543401 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-8954dd04-a071-412d-99f2-66ef9dc65e38 req-2b9f76ef-77c4-4135-b4f1-a0be9416691c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d22b60d-19fe-4dca-8eef-821db5a4dc55", "tag": "21fae4ca-fb3d-4b09-8071-928df2baff45"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:23:07.543932 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7bdb1882-dbf5-4a75-b0ca-d900ad3abc15 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:07.545113 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7bdb1882-dbf5-4a75-b0ca-d900ad3abc15 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:07.561938 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-8954dd04-a071-412d-99f2-66ef9dc65e38 req-2b9f76ef-77c4-4135-b4f1-a0be9416691c service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:07.562494 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-8954dd04-a071-412d-99f2-66ef9dc65e38 req-2b9f76ef-77c4-4135-b4f1-a0be9416691c service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:07.583760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-8954dd04-a071-412d-99f2-66ef9dc65e38 req-2b9f76ef-77c4-4135-b4f1-a0be9416691c service nova] Creating event network-changed:21fae4ca-fb3d-4b09-8071-928df2baff45 for instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 on hv-cinder-83735 Jun 16 17:23:07.594709 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-8954dd04-a071-412d-99f2-66ef9dc65e38 req-2b9f76ef-77c4-4135-b4f1-a0be9416691c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055871 Jun 16 17:23:07.595330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 26/54] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:23:07.621853 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b11464d0-1ecb-4aed-8cd7-fa3d279f0508 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:07.625512 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b11464d0-1ecb-4aed-8cd7-fa3d279f0508 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:07.638522 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b11464d0-1ecb-4aed-8cd7-fa3d279f0508 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:07.638982 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b11464d0-1ecb-4aed-8cd7-fa3d279f0508 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:07.639777 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b11464d0-1ecb-4aed-8cd7-fa3d279f0508 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:07.640210 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b11464d0-1ecb-4aed-8cd7-fa3d279f0508 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:07.919929 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7bdb1882-dbf5-4a75-b0ca-d900ad3abc15 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:07.938953 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7bdb1882-dbf5-4a75-b0ca-d900ad3abc15 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:07.941921 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7bdb1882-dbf5-4a75-b0ca-d900ad3abc15 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:07.946689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7bdb1882-dbf5-4a75-b0ca-d900ad3abc15 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.440995 Jun 16 17:23:07.947549 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 29/55] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:07 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:08.308927 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-b11464d0-1ecb-4aed-8cd7-fa3d279f0508 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:08.321318 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b11464d0-1ecb-4aed-8cd7-fa3d279f0508 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 0.704599 Jun 16 17:23:08.322606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 27/56] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:07 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:08.514853 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-9d095e51-c5e2-4656-97c5-5d3b769aec74 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:08.515671 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-9d095e51-c5e2-4656-97c5-5d3b769aec74 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:08.522494 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9d095e51-c5e2-4656-97c5-5d3b769aec74 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:08.523220 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9d095e51-c5e2-4656-97c5-5d3b769aec74 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:08.524577 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9d095e51-c5e2-4656-97c5-5d3b769aec74 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:08.531177 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-de21d63c-7c95-4c91-89cc-79f5e7352928 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:08.532149 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-de21d63c-7c95-4c91-89cc-79f5e7352928 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:08.538531 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9d095e51-c5e2-4656-97c5-5d3b769aec74 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:08.542873 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-de21d63c-7c95-4c91-89cc-79f5e7352928 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:08.545870 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-de21d63c-7c95-4c91-89cc-79f5e7352928 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:08.546780 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-de21d63c-7c95-4c91-89cc-79f5e7352928 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:08.548333 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-de21d63c-7c95-4c91-89cc-79f5e7352928 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:08.784227 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-9d095e51-c5e2-4656-97c5-5d3b769aec74 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:08.798723 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-9d095e51-c5e2-4656-97c5-5d3b769aec74 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.285312 Jun 16 17:23:08.802071 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 30/57] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:08 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:08.821481 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-de21d63c-7c95-4c91-89cc-79f5e7352928 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:08.832407 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-de21d63c-7c95-4c91-89cc-79f5e7352928 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 0.306360 Jun 16 17:23:08.834364 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 28/58] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:08 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:08.965464 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-cb6f5812-81b9-4864-853c-764b096cd000 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:08.966090 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-cb6f5812-81b9-4864-853c-764b096cd000 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:08.979297 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cb6f5812-81b9-4864-853c-764b096cd000 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:08.979746 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cb6f5812-81b9-4864-853c-764b096cd000 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:08.980891 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cb6f5812-81b9-4864-853c-764b096cd000 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:08.981524 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cb6f5812-81b9-4864-853c-764b096cd000 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:09.217231 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-cb6f5812-81b9-4864-853c-764b096cd000 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:09.231471 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-cb6f5812-81b9-4864-853c-764b096cd000 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:09.233807 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-cb6f5812-81b9-4864-853c-764b096cd000 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:09.236028 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-cb6f5812-81b9-4864-853c-764b096cd000 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.274655 Jun 16 17:23:09.237216 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 31/59] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:08 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:23:09.340378 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f6422923-55d5-4346-abeb-2e07da8d1985 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:09.341371 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f6422923-55d5-4346-abeb-2e07da8d1985 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:09.350723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f6422923-55d5-4346-abeb-2e07da8d1985 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:09.351176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f6422923-55d5-4346-abeb-2e07da8d1985 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:09.353398 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f6422923-55d5-4346-abeb-2e07da8d1985 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:09.353838 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f6422923-55d5-4346-abeb-2e07da8d1985 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:09.512711 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f6422923-55d5-4346-abeb-2e07da8d1985 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:09.520360 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f6422923-55d5-4346-abeb-2e07da8d1985 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 0.185340 Jun 16 17:23:09.521673 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 29/60] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:09 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:09.615800 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-6945ab37-3d7a-4257-9d38-ffcbf3d9da6b req-b1debcfd-da55-4bc1-8a1e-87028a3a4900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab2e7148-fa86-4648-9e4b-87e27fcf1147", "tag": "2da50d5c-d328-4853-a261-6bd0c6378dcd"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:23:09.627722 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-6945ab37-3d7a-4257-9d38-ffcbf3d9da6b req-b1debcfd-da55-4bc1-8a1e-87028a3a4900 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:09.628495 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-6945ab37-3d7a-4257-9d38-ffcbf3d9da6b req-b1debcfd-da55-4bc1-8a1e-87028a3a4900 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:09.642483 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-6945ab37-3d7a-4257-9d38-ffcbf3d9da6b req-b1debcfd-da55-4bc1-8a1e-87028a3a4900 service nova] Creating event network-changed:2da50d5c-d328-4853-a261-6bd0c6378dcd for instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 on hv-cinder-83735 Jun 16 17:23:09.648309 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-6945ab37-3d7a-4257-9d38-ffcbf3d9da6b req-b1debcfd-da55-4bc1-8a1e-87028a3a4900 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039079 Jun 16 17:23:09.650006 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 32/61] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:23:09.818940 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-90c8f6c9-ca99-43bc-aa4f-b79d6e52de6a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:09.819771 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-90c8f6c9-ca99-43bc-aa4f-b79d6e52de6a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:09.827608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-90c8f6c9-ca99-43bc-aa4f-b79d6e52de6a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:09.828817 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-90c8f6c9-ca99-43bc-aa4f-b79d6e52de6a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:09.829768 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-90c8f6c9-ca99-43bc-aa4f-b79d6e52de6a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:09.830551 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-90c8f6c9-ca99-43bc-aa4f-b79d6e52de6a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:09.850893 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b80662de-a4db-46d6-a714-c8fbc3642941 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:09.851904 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-b80662de-a4db-46d6-a714-c8fbc3642941 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:09.860779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b80662de-a4db-46d6-a714-c8fbc3642941 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:09.861267 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b80662de-a4db-46d6-a714-c8fbc3642941 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:09.862040 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b80662de-a4db-46d6-a714-c8fbc3642941 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:09.862818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b80662de-a4db-46d6-a714-c8fbc3642941 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:10.057069 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-90c8f6c9-ca99-43bc-aa4f-b79d6e52de6a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:10.070145 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-90c8f6c9-ca99-43bc-aa4f-b79d6e52de6a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.255080 Jun 16 17:23:10.072940 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 30/62] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:09 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:10.082415 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b80662de-a4db-46d6-a714-c8fbc3642941 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:10.096540 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b80662de-a4db-46d6-a714-c8fbc3642941 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 0.250101 Jun 16 17:23:10.097143 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 33/63] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:09 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:10.254746 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5d8a4d43-50cc-4fba-92a9-235830f1d797 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:10.255789 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-5d8a4d43-50cc-4fba-92a9-235830f1d797 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:10.263533 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5d8a4d43-50cc-4fba-92a9-235830f1d797 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:10.264051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5d8a4d43-50cc-4fba-92a9-235830f1d797 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:10.265293 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5d8a4d43-50cc-4fba-92a9-235830f1d797 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:10.265905 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5d8a4d43-50cc-4fba-92a9-235830f1d797 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:10.538044 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-0672538e-2d44-4a0f-88f3-aa7054754be4 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:10.539042 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-0672538e-2d44-4a0f-88f3-aa7054754be4 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:10.549975 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0672538e-2d44-4a0f-88f3-aa7054754be4 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:10.550614 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0672538e-2d44-4a0f-88f3-aa7054754be4 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:10.557463 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0672538e-2d44-4a0f-88f3-aa7054754be4 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:10.558294 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0672538e-2d44-4a0f-88f3-aa7054754be4 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:10.749159 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5d8a4d43-50cc-4fba-92a9-235830f1d797 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:10.761728 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5d8a4d43-50cc-4fba-92a9-235830f1d797 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:10.771188 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5d8a4d43-50cc-4fba-92a9-235830f1d797 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:10.772598 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-5d8a4d43-50cc-4fba-92a9-235830f1d797 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.521965 Jun 16 17:23:10.773398 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 31/64] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:10 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:11.089800 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-de36994e-82c7-479d-b8a0-67194b5b59fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:11.090539 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-de36994e-82c7-479d-b8a0-67194b5b59fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:11.096929 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-de36994e-82c7-479d-b8a0-67194b5b59fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:11.097413 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-de36994e-82c7-479d-b8a0-67194b5b59fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:11.098178 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-de36994e-82c7-479d-b8a0-67194b5b59fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:11.113439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-de36994e-82c7-479d-b8a0-67194b5b59fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:11.483006 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0672538e-2d44-4a0f-88f3-aa7054754be4 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:11.499191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-0672538e-2d44-4a0f-88f3-aa7054754be4 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 0.964861 Jun 16 17:23:11.502045 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 34/65] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:10 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:11.523861 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-adc21933-c5d9-4f5c-bf8d-3028951b9eb7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:11.527789 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-adc21933-c5d9-4f5c-bf8d-3028951b9eb7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:11.547682 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-adc21933-c5d9-4f5c-bf8d-3028951b9eb7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:11.549306 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-adc21933-c5d9-4f5c-bf8d-3028951b9eb7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:11.578327 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-adc21933-c5d9-4f5c-bf8d-3028951b9eb7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:11.579328 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-adc21933-c5d9-4f5c-bf8d-3028951b9eb7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:11.640159 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-de36994e-82c7-479d-b8a0-67194b5b59fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:11.649236 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-de36994e-82c7-479d-b8a0-67194b5b59fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.563563 Jun 16 17:23:11.652978 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 32/66] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:11 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:11.791558 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-306716d5-662c-4cf4-8e5c-48d925f44c39 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:11.792207 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-306716d5-662c-4cf4-8e5c-48d925f44c39 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:11.803233 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-306716d5-662c-4cf4-8e5c-48d925f44c39 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:11.803681 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-306716d5-662c-4cf4-8e5c-48d925f44c39 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:11.804444 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-306716d5-662c-4cf4-8e5c-48d925f44c39 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:11.814451 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-306716d5-662c-4cf4-8e5c-48d925f44c39 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:11.966430 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-adc21933-c5d9-4f5c-bf8d-3028951b9eb7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:11.983214 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-adc21933-c5d9-4f5c-bf8d-3028951b9eb7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 0.479272 Jun 16 17:23:11.994013 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 35/67] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:11 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:12.340592 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-306716d5-662c-4cf4-8e5c-48d925f44c39 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:12.354122 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-306716d5-662c-4cf4-8e5c-48d925f44c39 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:12.358518 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-306716d5-662c-4cf4-8e5c-48d925f44c39 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:12.361408 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-306716d5-662c-4cf4-8e5c-48d925f44c39 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.573069 Jun 16 17:23:12.362793 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 33/68] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:11 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:23:12.523059 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5cb04819-8b2e-49cc-8adc-446cc9bb3cd1 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:12.525490 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5cb04819-8b2e-49cc-8adc-446cc9bb3cd1 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:12.541408 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5cb04819-8b2e-49cc-8adc-446cc9bb3cd1 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:12.541408 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5cb04819-8b2e-49cc-8adc-446cc9bb3cd1 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:12.541408 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5cb04819-8b2e-49cc-8adc-446cc9bb3cd1 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:12.541408 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5cb04819-8b2e-49cc-8adc-446cc9bb3cd1 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:12.677744 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-cf0c8310-5724-442a-9baa-b7d93b812da3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:12.678338 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-cf0c8310-5724-442a-9baa-b7d93b812da3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:12.689462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cf0c8310-5724-442a-9baa-b7d93b812da3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:12.712918 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cf0c8310-5724-442a-9baa-b7d93b812da3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:12.721585 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cf0c8310-5724-442a-9baa-b7d93b812da3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:12.722392 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cf0c8310-5724-442a-9baa-b7d93b812da3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:12.755605 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-5cb04819-8b2e-49cc-8adc-446cc9bb3cd1 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:12.772031 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5cb04819-8b2e-49cc-8adc-446cc9bb3cd1 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 0.251404 Jun 16 17:23:12.772669 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 36/69] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:12 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:13.003489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-3d327341-1876-43ea-b663-946bb83db532 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:13.003489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-3d327341-1876-43ea-b663-946bb83db532 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:13.007662 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3d327341-1876-43ea-b663-946bb83db532 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:13.008158 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3d327341-1876-43ea-b663-946bb83db532 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:13.009010 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3d327341-1876-43ea-b663-946bb83db532 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:13.020488 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3d327341-1876-43ea-b663-946bb83db532 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:13.389428 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-3d327341-1876-43ea-b663-946bb83db532 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:13.403844 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-3d327341-1876-43ea-b663-946bb83db532 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 0.407750 Jun 16 17:23:13.405084 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 37/70] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:12 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:13.411643 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:13.414767 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7a7049e5-2916-44de-8232-fff3ac380944 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:13.416151 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-7a7049e5-2916-44de-8232-fff3ac380944 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:13.427028 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7a7049e5-2916-44de-8232-fff3ac380944 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:13.427901 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7a7049e5-2916-44de-8232-fff3ac380944 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:13.428889 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7a7049e5-2916-44de-8232-fff3ac380944 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:13.429463 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7a7049e5-2916-44de-8232-fff3ac380944 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:13.552502 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-cf0c8310-5724-442a-9baa-b7d93b812da3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:13.573589 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-cf0c8310-5724-442a-9baa-b7d93b812da3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.898736 Jun 16 17:23:13.574182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 34/71] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:12 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:13.630394 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7a7049e5-2916-44de-8232-fff3ac380944 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:13.648028 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7a7049e5-2916-44de-8232-fff3ac380944 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:13.652526 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7a7049e5-2916-44de-8232-fff3ac380944 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:13.654657 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7a7049e5-2916-44de-8232-fff3ac380944 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.248177 Jun 16 17:23:13.655534 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 38/72] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:13 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:13.788920 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-cb874a30-ff6c-40b2-9e52-7e38ff8ce347 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:13.789616 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-cb874a30-ff6c-40b2-9e52-7e38ff8ce347 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:13.796817 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cb874a30-ff6c-40b2-9e52-7e38ff8ce347 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:13.797648 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cb874a30-ff6c-40b2-9e52-7e38ff8ce347 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:13.798639 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cb874a30-ff6c-40b2-9e52-7e38ff8ce347 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:13.799273 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cb874a30-ff6c-40b2-9e52-7e38ff8ce347 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:14.024174 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-cb874a30-ff6c-40b2-9e52-7e38ff8ce347 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:14.033102 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-cb874a30-ff6c-40b2-9e52-7e38ff8ce347 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 0.247930 Jun 16 17:23:14.033871 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 35/73] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:13 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:14.423829 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-cd4aa6d8-0a2f-423e-bf03-cc9f49ad075e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:14.425363 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-cd4aa6d8-0a2f-423e-bf03-cc9f49ad075e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:14.435938 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cd4aa6d8-0a2f-423e-bf03-cc9f49ad075e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:14.436556 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cd4aa6d8-0a2f-423e-bf03-cc9f49ad075e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:14.437724 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cd4aa6d8-0a2f-423e-bf03-cc9f49ad075e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:14.438309 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cd4aa6d8-0a2f-423e-bf03-cc9f49ad075e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:14.594615 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7b3c8626-8d42-4f1c-aea7-8376d899624c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:14.595212 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7b3c8626-8d42-4f1c-aea7-8376d899624c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:14.604639 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7b3c8626-8d42-4f1c-aea7-8376d899624c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:14.605417 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7b3c8626-8d42-4f1c-aea7-8376d899624c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:14.607776 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7b3c8626-8d42-4f1c-aea7-8376d899624c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:14.608386 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7b3c8626-8d42-4f1c-aea7-8376d899624c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:14.647906 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-cd4aa6d8-0a2f-423e-bf03-cc9f49ad075e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:14.657111 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-cd4aa6d8-0a2f-423e-bf03-cc9f49ad075e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 0.239602 Jun 16 17:23:14.657735 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 39/74] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:14 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:14.678713 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8b8468da-a96c-4f32-aa68-6b3e3341c407 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:14.679335 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-8b8468da-a96c-4f32-aa68-6b3e3341c407 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:14.685828 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8b8468da-a96c-4f32-aa68-6b3e3341c407 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:14.686264 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8b8468da-a96c-4f32-aa68-6b3e3341c407 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:14.687024 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8b8468da-a96c-4f32-aa68-6b3e3341c407 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:14.687445 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8b8468da-a96c-4f32-aa68-6b3e3341c407 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:14.691874 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=100 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:14.802375 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7b3c8626-8d42-4f1c-aea7-8376d899624c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:14.818406 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7b3c8626-8d42-4f1c-aea7-8376d899624c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.227611 Jun 16 17:23:14.820014 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 36/75] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:14 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:14.864649 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8b8468da-a96c-4f32-aa68-6b3e3341c407 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:14.880509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8b8468da-a96c-4f32-aa68-6b3e3341c407 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:14.882373 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8b8468da-a96c-4f32-aa68-6b3e3341c407 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:14.883948 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8b8468da-a96c-4f32-aa68-6b3e3341c407 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.208936 Jun 16 17:23:14.884680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 40/76] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:14 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:15.053826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8a8eff65-c576-49c8-8018-f4c52dac711f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:15.054508 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8a8eff65-c576-49c8-8018-f4c52dac711f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:15.061225 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8a8eff65-c576-49c8-8018-f4c52dac711f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:15.061703 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8a8eff65-c576-49c8-8018-f4c52dac711f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:15.062435 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8a8eff65-c576-49c8-8018-f4c52dac711f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:15.062967 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8a8eff65-c576-49c8-8018-f4c52dac711f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:15.287970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8a8eff65-c576-49c8-8018-f4c52dac711f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:15.299420 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8a8eff65-c576-49c8-8018-f4c52dac711f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 0.252604 Jun 16 17:23:15.300256 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 37/77] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:15 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:15.676897 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-abaf711e-9426-4036-80e7-02900ee90055 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:15.677608 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-abaf711e-9426-4036-80e7-02900ee90055 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:15.685911 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-abaf711e-9426-4036-80e7-02900ee90055 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:15.686508 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-abaf711e-9426-4036-80e7-02900ee90055 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:15.687348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-abaf711e-9426-4036-80e7-02900ee90055 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:15.688204 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-abaf711e-9426-4036-80e7-02900ee90055 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:15.837616 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-817d2aa2-5d0d-42fd-ac1f-dae0a8a763fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:15.838140 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-817d2aa2-5d0d-42fd-ac1f-dae0a8a763fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:15.844934 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-817d2aa2-5d0d-42fd-ac1f-dae0a8a763fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:15.845436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-817d2aa2-5d0d-42fd-ac1f-dae0a8a763fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:15.846214 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-817d2aa2-5d0d-42fd-ac1f-dae0a8a763fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:15.846648 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-817d2aa2-5d0d-42fd-ac1f-dae0a8a763fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:15.861924 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-abaf711e-9426-4036-80e7-02900ee90055 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:15.877095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-abaf711e-9426-4036-80e7-02900ee90055 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 0.205441 Jun 16 17:23:15.878081 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 41/78] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:15 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:15.902033 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a0af895f-aa54-48ca-aea7-a8f5f2acbb0f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:15.902831 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a0af895f-aa54-48ca-aea7-a8f5f2acbb0f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:15.910241 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a0af895f-aa54-48ca-aea7-a8f5f2acbb0f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:15.910941 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a0af895f-aa54-48ca-aea7-a8f5f2acbb0f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:15.912072 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a0af895f-aa54-48ca-aea7-a8f5f2acbb0f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:15.912648 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a0af895f-aa54-48ca-aea7-a8f5f2acbb0f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:16.201087 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-817d2aa2-5d0d-42fd-ac1f-dae0a8a763fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:16.201393 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a0af895f-aa54-48ca-aea7-a8f5f2acbb0f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:16.218652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a0af895f-aa54-48ca-aea7-a8f5f2acbb0f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:16.219846 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-817d2aa2-5d0d-42fd-ac1f-dae0a8a763fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.386854 Jun 16 17:23:16.220847 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a0af895f-aa54-48ca-aea7-a8f5f2acbb0f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:16.222584 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a0af895f-aa54-48ca-aea7-a8f5f2acbb0f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.324870 Jun 16 17:23:16.223656 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 42/79] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:15 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:16.236717 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 38/80] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:15 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:16.323964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-67b95b5c-69ec-4ab5-853e-a55238861a5f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:16.328714 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-67b95b5c-69ec-4ab5-853e-a55238861a5f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:16.338426 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-67b95b5c-69ec-4ab5-853e-a55238861a5f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:16.339604 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-67b95b5c-69ec-4ab5-853e-a55238861a5f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:16.340527 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-67b95b5c-69ec-4ab5-853e-a55238861a5f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:16.341110 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-67b95b5c-69ec-4ab5-853e-a55238861a5f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:16.414854 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:16.514907 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-67b95b5c-69ec-4ab5-853e-a55238861a5f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:16.523299 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-67b95b5c-69ec-4ab5-853e-a55238861a5f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 0.210622 Jun 16 17:23:16.524686 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 43/81] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:16 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:16.894350 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-16c288fe-432f-4dea-960f-7f44bf8e0b0c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:16.895656 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-16c288fe-432f-4dea-960f-7f44bf8e0b0c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:16.902745 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-16c288fe-432f-4dea-960f-7f44bf8e0b0c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:16.903489 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-16c288fe-432f-4dea-960f-7f44bf8e0b0c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:16.904786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-16c288fe-432f-4dea-960f-7f44bf8e0b0c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:16.917374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-16c288fe-432f-4dea-960f-7f44bf8e0b0c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:17.168259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-16c288fe-432f-4dea-960f-7f44bf8e0b0c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:17.176747 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-16c288fe-432f-4dea-960f-7f44bf8e0b0c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 0.286171 Jun 16 17:23:17.178269 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 39/82] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:16 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:17.247272 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-98a28141-3aca-4593-a3b6-72cfdf2b504c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:17.249953 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-2261a929-46cc-4bde-883b-0ccfeec4dd6c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:17.250823 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-2261a929-46cc-4bde-883b-0ccfeec4dd6c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:17.251906 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-98a28141-3aca-4593-a3b6-72cfdf2b504c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:17.275143 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-98a28141-3aca-4593-a3b6-72cfdf2b504c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:17.276201 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2261a929-46cc-4bde-883b-0ccfeec4dd6c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:17.277109 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2261a929-46cc-4bde-883b-0ccfeec4dd6c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:17.281802 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-98a28141-3aca-4593-a3b6-72cfdf2b504c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:17.284600 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-98a28141-3aca-4593-a3b6-72cfdf2b504c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:17.284875 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2261a929-46cc-4bde-883b-0ccfeec4dd6c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:17.285901 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2261a929-46cc-4bde-883b-0ccfeec4dd6c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:17.286514 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-98a28141-3aca-4593-a3b6-72cfdf2b504c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:17.551513 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2261a929-46cc-4bde-883b-0ccfeec4dd6c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:17.562740 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2261a929-46cc-4bde-883b-0ccfeec4dd6c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:17.564728 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2261a929-46cc-4bde-883b-0ccfeec4dd6c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:17.567653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-2261a929-46cc-4bde-883b-0ccfeec4dd6c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.329036 Jun 16 17:23:17.580143 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 40/83] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:17 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:17.615513 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-98a28141-3aca-4593-a3b6-72cfdf2b504c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:17.626306 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-98a28141-3aca-4593-a3b6-72cfdf2b504c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.384311 Jun 16 17:23:17.630054 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 44/84] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:17 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:17.646926 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-904be30c-4bbd-4076-9686-2a40e957fe3c tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:17.648741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-904be30c-4bbd-4076-9686-2a40e957fe3c tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:17.685499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-904be30c-4bbd-4076-9686-2a40e957fe3c tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:17.687008 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-904be30c-4bbd-4076-9686-2a40e957fe3c tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:17.688037 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-904be30c-4bbd-4076-9686-2a40e957fe3c tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:17.688911 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-904be30c-4bbd-4076-9686-2a40e957fe3c tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:17.793215 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-0ef83de0-0807-4884-99c1-cb257e658e52 req-56114eb4-8e02-4b79-ba9d-2fa45326d0bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75957299-3d36-4f9c-a081-9e621c88225c", "name": "network-vif-plugged", "status": "completed", "tag": "24585d4c-eda6-469f-a310-d2d5f70274a1"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:23:17.809636 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-0ef83de0-0807-4884-99c1-cb257e658e52 req-56114eb4-8e02-4b79-ba9d-2fa45326d0bd service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:17.810384 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-0ef83de0-0807-4884-99c1-cb257e658e52 req-56114eb4-8e02-4b79-ba9d-2fa45326d0bd service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:17.827390 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-0ef83de0-0807-4884-99c1-cb257e658e52 req-56114eb4-8e02-4b79-ba9d-2fa45326d0bd service nova] Creating event network-vif-plugged:24585d4c-eda6-469f-a310-d2d5f70274a1 for instance 75957299-3d36-4f9c-a081-9e621c88225c on hv-cinder-83735 Jun 16 17:23:17.833329 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-0ef83de0-0807-4884-99c1-cb257e658e52 req-56114eb4-8e02-4b79-ba9d-2fa45326d0bd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251598 Jun 16 17:23:17.834271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 41/85] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:23:17.990762 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-904be30c-4bbd-4076-9686-2a40e957fe3c tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:18.001999 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-904be30c-4bbd-4076-9686-2a40e957fe3c tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 0.369251 Jun 16 17:23:18.002795 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 45/86] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:17 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:18.210061 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-6b3f6b9a-eb6a-4239-b537-9c0e884719b9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:18.212653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-6b3f6b9a-eb6a-4239-b537-9c0e884719b9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:18.226798 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6b3f6b9a-eb6a-4239-b537-9c0e884719b9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:18.228583 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6b3f6b9a-eb6a-4239-b537-9c0e884719b9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:18.230188 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6b3f6b9a-eb6a-4239-b537-9c0e884719b9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:18.232171 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6b3f6b9a-eb6a-4239-b537-9c0e884719b9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:18.474757 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-6b3f6b9a-eb6a-4239-b537-9c0e884719b9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:18.479734 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=100 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:18.490541 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-6b3f6b9a-eb6a-4239-b537-9c0e884719b9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 0.294555 Jun 16 17:23:18.491459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 42/87] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:18 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:18.585941 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2c68960b-9043-4129-a233-337b919fae52 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:18.587378 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2c68960b-9043-4129-a233-337b919fae52 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:18.593985 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2c68960b-9043-4129-a233-337b919fae52 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:18.594646 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2c68960b-9043-4129-a233-337b919fae52 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:18.595588 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2c68960b-9043-4129-a233-337b919fae52 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:18.596390 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2c68960b-9043-4129-a233-337b919fae52 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:18.648919 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-da7dba86-f9a4-4560-a978-80e1755cc0a0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:18.650163 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-da7dba86-f9a4-4560-a978-80e1755cc0a0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:18.657610 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-da7dba86-f9a4-4560-a978-80e1755cc0a0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:18.658450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-da7dba86-f9a4-4560-a978-80e1755cc0a0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:18.659606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-da7dba86-f9a4-4560-a978-80e1755cc0a0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:18.660123 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-da7dba86-f9a4-4560-a978-80e1755cc0a0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:18.788771 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2c68960b-9043-4129-a233-337b919fae52 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:18.811789 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2c68960b-9043-4129-a233-337b919fae52 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:18.813640 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2c68960b-9043-4129-a233-337b919fae52 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:18.814921 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2c68960b-9043-4129-a233-337b919fae52 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.233174 Jun 16 17:23:18.815479 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 46/88] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:18 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:18.855217 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-da7dba86-f9a4-4560-a978-80e1755cc0a0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:18.865006 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-da7dba86-f9a4-4560-a978-80e1755cc0a0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.222749 Jun 16 17:23:18.865714 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 43/89] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:18 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:19.034122 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8d7f673d-8358-4c30-8e4a-a747a773f03a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:19.035484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-8d7f673d-8358-4c30-8e4a-a747a773f03a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:19.051726 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8d7f673d-8358-4c30-8e4a-a747a773f03a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:19.052678 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8d7f673d-8358-4c30-8e4a-a747a773f03a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:19.054216 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8d7f673d-8358-4c30-8e4a-a747a773f03a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:19.055073 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8d7f673d-8358-4c30-8e4a-a747a773f03a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:19.237527 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8d7f673d-8358-4c30-8e4a-a747a773f03a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:19.248192 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8d7f673d-8358-4c30-8e4a-a747a773f03a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 0.218562 Jun 16 17:23:19.249800 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 47/90] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:19 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:19.508998 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-22fb9e3d-073b-47b6-aec9-814f725167bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:19.509659 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-22fb9e3d-073b-47b6-aec9-814f725167bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:19.521921 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-22fb9e3d-073b-47b6-aec9-814f725167bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:19.522367 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-22fb9e3d-073b-47b6-aec9-814f725167bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:19.523139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-22fb9e3d-073b-47b6-aec9-814f725167bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:19.523624 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-22fb9e3d-073b-47b6-aec9-814f725167bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:19.682771 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-22fb9e3d-073b-47b6-aec9-814f725167bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:19.692971 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-22fb9e3d-073b-47b6-aec9-814f725167bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 0.187835 Jun 16 17:23:19.702517 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 44/91] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:19 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:19.833941 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-6c06346b-2ad4-4055-931f-214aa295d132 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:19.834583 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-6c06346b-2ad4-4055-931f-214aa295d132 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:19.841064 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6c06346b-2ad4-4055-931f-214aa295d132 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:19.841548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6c06346b-2ad4-4055-931f-214aa295d132 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:19.842313 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6c06346b-2ad4-4055-931f-214aa295d132 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:19.842743 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6c06346b-2ad4-4055-931f-214aa295d132 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:19.855397 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-fa2a2543-98b4-44ff-9504-270fff42aa19 req-dab7c398-8d81-416c-9af8-221c797e711f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ea9630-ef03-47fd-aa60-695a36081c19", "name": "network-vif-plugged", "status": "completed", "tag": "6fa0a160-b8b9-480d-91ad-c84aa7d2485a"}, {"server_uuid": "57b787b3-74c7-4e30-9f10-acea71d19c0c", "name": "network-vif-plugged", "status": "completed", "tag": "793bfabc-d2dc-472c-95a2-270f46bad4dc"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:23:19.878704 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-fa2a2543-98b4-44ff-9504-270fff42aa19 req-dab7c398-8d81-416c-9af8-221c797e711f service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:19.878925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-fa2a2543-98b4-44ff-9504-270fff42aa19 req-dab7c398-8d81-416c-9af8-221c797e711f service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:19.898772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-fa2a2543-98b4-44ff-9504-270fff42aa19 req-dab7c398-8d81-416c-9af8-221c797e711f service nova] Creating event network-vif-plugged:6fa0a160-b8b9-480d-91ad-c84aa7d2485a for instance 90ea9630-ef03-47fd-aa60-695a36081c19 on hv-cinder-83735 Jun 16 17:23:19.900179 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-fa2a2543-98b4-44ff-9504-270fff42aa19 req-dab7c398-8d81-416c-9af8-221c797e711f service nova] Creating event network-vif-plugged:793bfabc-d2dc-472c-95a2-270f46bad4dc for instance 57b787b3-74c7-4e30-9f10-acea71d19c0c on hv-cinder-83735 Jun 16 17:23:19.906800 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-fa2a2543-98b4-44ff-9504-270fff42aa19 req-dab7c398-8d81-416c-9af8-221c797e711f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059682 Jun 16 17:23:19.907396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 45/92] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:23:19.912676 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a53f3901-3de3-4f30-99c5-30dec7bc5b44 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:19.913703 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a53f3901-3de3-4f30-99c5-30dec7bc5b44 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:19.920812 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a53f3901-3de3-4f30-99c5-30dec7bc5b44 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:19.921249 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a53f3901-3de3-4f30-99c5-30dec7bc5b44 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:19.922306 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a53f3901-3de3-4f30-99c5-30dec7bc5b44 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:19.922883 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a53f3901-3de3-4f30-99c5-30dec7bc5b44 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:20.057357 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6c06346b-2ad4-4055-931f-214aa295d132 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:20.069911 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6c06346b-2ad4-4055-931f-214aa295d132 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:20.072652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6c06346b-2ad4-4055-931f-214aa295d132 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:20.075403 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-6c06346b-2ad4-4055-931f-214aa295d132 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.245189 Jun 16 17:23:20.077046 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 48/93] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:19 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:20.162465 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a53f3901-3de3-4f30-99c5-30dec7bc5b44 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:20.179489 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a53f3901-3de3-4f30-99c5-30dec7bc5b44 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.270877 Jun 16 17:23:20.199694 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 46/94] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:19 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:20.270119 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-0997a18a-6785-444d-93fb-45ce3ad9a16a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:20.272123 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-0997a18a-6785-444d-93fb-45ce3ad9a16a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:20.286591 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0997a18a-6785-444d-93fb-45ce3ad9a16a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:20.287615 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0997a18a-6785-444d-93fb-45ce3ad9a16a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:20.291723 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0997a18a-6785-444d-93fb-45ce3ad9a16a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:20.292203 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0997a18a-6785-444d-93fb-45ce3ad9a16a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:20.721841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7d3d675a-b3e8-46fe-8eea-bc432dc52578 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:20.723170 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7d3d675a-b3e8-46fe-8eea-bc432dc52578 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:20.733502 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7d3d675a-b3e8-46fe-8eea-bc432dc52578 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:20.734940 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7d3d675a-b3e8-46fe-8eea-bc432dc52578 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:20.736172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7d3d675a-b3e8-46fe-8eea-bc432dc52578 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:20.736833 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7d3d675a-b3e8-46fe-8eea-bc432dc52578 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:20.901023 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0997a18a-6785-444d-93fb-45ce3ad9a16a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:20.910256 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-0997a18a-6785-444d-93fb-45ce3ad9a16a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 0.646743 Jun 16 17:23:20.918780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 49/95] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:20 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:20.932350 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7d3d675a-b3e8-46fe-8eea-bc432dc52578 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:20.944220 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7d3d675a-b3e8-46fe-8eea-bc432dc52578 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 0.238252 Jun 16 17:23:20.944814 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 47/96] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:20 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:21.094720 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a0f5988b-ae96-4671-9580-45f794ff4bc0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:21.095329 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a0f5988b-ae96-4671-9580-45f794ff4bc0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:21.112099 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a0f5988b-ae96-4671-9580-45f794ff4bc0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:21.113165 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a0f5988b-ae96-4671-9580-45f794ff4bc0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:21.114495 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a0f5988b-ae96-4671-9580-45f794ff4bc0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:21.115199 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a0f5988b-ae96-4671-9580-45f794ff4bc0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:21.208994 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-35753821-2be5-454c-8dfc-9d89a4872e1e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:21.209698 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-35753821-2be5-454c-8dfc-9d89a4872e1e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:21.221152 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-35753821-2be5-454c-8dfc-9d89a4872e1e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:21.223040 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-35753821-2be5-454c-8dfc-9d89a4872e1e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:21.224990 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-35753821-2be5-454c-8dfc-9d89a4872e1e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:21.225481 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-35753821-2be5-454c-8dfc-9d89a4872e1e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:21.276227 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a0f5988b-ae96-4671-9580-45f794ff4bc0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:21.286474 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a0f5988b-ae96-4671-9580-45f794ff4bc0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:21.288647 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a0f5988b-ae96-4671-9580-45f794ff4bc0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:21.290258 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a0f5988b-ae96-4671-9580-45f794ff4bc0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.199509 Jun 16 17:23:21.291320 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 50/97] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:21 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:23:21.399384 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-35753821-2be5-454c-8dfc-9d89a4872e1e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:21.411284 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-35753821-2be5-454c-8dfc-9d89a4872e1e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.209893 Jun 16 17:23:21.411798 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 48/98] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:21 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:21.928422 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-20882186-87a8-4f43-bb51-80e2a9156331 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:21.929364 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-20882186-87a8-4f43-bb51-80e2a9156331 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:21.935882 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-20882186-87a8-4f43-bb51-80e2a9156331 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:21.936284 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-20882186-87a8-4f43-bb51-80e2a9156331 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:21.937144 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-20882186-87a8-4f43-bb51-80e2a9156331 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:21.937485 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-20882186-87a8-4f43-bb51-80e2a9156331 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:21.960357 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9cb29614-c824-455c-a37d-50d5798a9773 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:21.960960 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-9cb29614-c824-455c-a37d-50d5798a9773 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:21.967267 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9cb29614-c824-455c-a37d-50d5798a9773 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:21.967912 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9cb29614-c824-455c-a37d-50d5798a9773 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:21.968899 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9cb29614-c824-455c-a37d-50d5798a9773 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:21.969569 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9cb29614-c824-455c-a37d-50d5798a9773 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:22.091860 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-20882186-87a8-4f43-bb51-80e2a9156331 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:22.100655 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-20882186-87a8-4f43-bb51-80e2a9156331 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 0.176208 Jun 16 17:23:22.101248 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 51/99] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:21 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:22.128229 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9cb29614-c824-455c-a37d-50d5798a9773 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:22.136667 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9cb29614-c824-455c-a37d-50d5798a9773 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 0.180103 Jun 16 17:23:22.137251 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 49/100] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:21 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:22.308536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-03e8ddc6-c0e5-4e4a-b379-b6a76015c2ec tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:22.309439 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-03e8ddc6-c0e5-4e4a-b379-b6a76015c2ec tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:22.316208 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-03e8ddc6-c0e5-4e4a-b379-b6a76015c2ec tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:22.317014 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-03e8ddc6-c0e5-4e4a-b379-b6a76015c2ec tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:22.317826 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-03e8ddc6-c0e5-4e4a-b379-b6a76015c2ec tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:22.318906 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-03e8ddc6-c0e5-4e4a-b379-b6a76015c2ec tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:22.428795 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-65fe8896-135f-4dab-a3d2-33fdde54024d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:22.429601 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-65fe8896-135f-4dab-a3d2-33fdde54024d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:22.436439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-65fe8896-135f-4dab-a3d2-33fdde54024d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:22.436870 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-65fe8896-135f-4dab-a3d2-33fdde54024d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:22.437862 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-65fe8896-135f-4dab-a3d2-33fdde54024d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:22.438295 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-65fe8896-135f-4dab-a3d2-33fdde54024d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:22.489764 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-03e8ddc6-c0e5-4e4a-b379-b6a76015c2ec tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:22.501942 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-03e8ddc6-c0e5-4e4a-b379-b6a76015c2ec tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:22.503438 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-03e8ddc6-c0e5-4e4a-b379-b6a76015c2ec tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:22.504551 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-03e8ddc6-c0e5-4e4a-b379-b6a76015c2ec tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.200346 Jun 16 17:23:22.505120 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 52/101] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:22 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:22.598280 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-65fe8896-135f-4dab-a3d2-33fdde54024d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:22.610015 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-65fe8896-135f-4dab-a3d2-33fdde54024d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.185999 Jun 16 17:23:22.610609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 50/102] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:22 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:23.119308 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-39889b02-398d-460a-a711-11ec40a39067 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:23.119864 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-39889b02-398d-460a-a711-11ec40a39067 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:23.126355 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-39889b02-398d-460a-a711-11ec40a39067 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:23.126795 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-39889b02-398d-460a-a711-11ec40a39067 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:23.127547 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-39889b02-398d-460a-a711-11ec40a39067 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:23.127970 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-39889b02-398d-460a-a711-11ec40a39067 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:23.153669 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a4a54b0a-f426-494d-8fec-03402500e21b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:23.154346 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a4a54b0a-f426-494d-8fec-03402500e21b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:23.165861 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a4a54b0a-f426-494d-8fec-03402500e21b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:23.166308 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a4a54b0a-f426-494d-8fec-03402500e21b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:23.167136 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a4a54b0a-f426-494d-8fec-03402500e21b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:23.167764 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a4a54b0a-f426-494d-8fec-03402500e21b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:23.260445 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-39889b02-398d-460a-a711-11ec40a39067 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:23.269278 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-39889b02-398d-460a-a711-11ec40a39067 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 0.154110 Jun 16 17:23:23.269869 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 53/103] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:23 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:23.311321 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a4a54b0a-f426-494d-8fec-03402500e21b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:23.318911 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a4a54b0a-f426-494d-8fec-03402500e21b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 0.169082 Jun 16 17:23:23.319499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 51/104] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:23 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:23.524872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-0bd8f3c3-5b25-4783-b499-71920abe1e41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:23.525531 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-0bd8f3c3-5b25-4783-b499-71920abe1e41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:23.532023 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0bd8f3c3-5b25-4783-b499-71920abe1e41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:23.532467 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0bd8f3c3-5b25-4783-b499-71920abe1e41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:23.533235 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0bd8f3c3-5b25-4783-b499-71920abe1e41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:23.533678 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0bd8f3c3-5b25-4783-b499-71920abe1e41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:23.627685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-91cb9fe1-7f62-4e3e-9bc6-a484edc00625 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:23.628296 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-91cb9fe1-7f62-4e3e-9bc6-a484edc00625 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:23.635155 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-91cb9fe1-7f62-4e3e-9bc6-a484edc00625 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:23.635608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-91cb9fe1-7f62-4e3e-9bc6-a484edc00625 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:23.636374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-91cb9fe1-7f62-4e3e-9bc6-a484edc00625 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:23.636802 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-91cb9fe1-7f62-4e3e-9bc6-a484edc00625 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:23.675611 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0bd8f3c3-5b25-4783-b499-71920abe1e41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:23.685721 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0bd8f3c3-5b25-4783-b499-71920abe1e41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:23.687097 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0bd8f3c3-5b25-4783-b499-71920abe1e41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:23.688254 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-0bd8f3c3-5b25-4783-b499-71920abe1e41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.168041 Jun 16 17:23:23.697724 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 54/105] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:23 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:23.785593 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-91cb9fe1-7f62-4e3e-9bc6-a484edc00625 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:23.793797 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-91cb9fe1-7f62-4e3e-9bc6-a484edc00625 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.169917 Jun 16 17:23:23.794368 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 52/106] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:23 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:24.286214 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f32f52c1-042d-422b-8af0-d0aed49bf44f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:24.286826 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f32f52c1-042d-422b-8af0-d0aed49bf44f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:24.293622 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f32f52c1-042d-422b-8af0-d0aed49bf44f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:24.294053 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f32f52c1-042d-422b-8af0-d0aed49bf44f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:24.294795 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f32f52c1-042d-422b-8af0-d0aed49bf44f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:24.295217 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f32f52c1-042d-422b-8af0-d0aed49bf44f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:24.338033 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f1585d7c-92d0-493c-a77b-bb2a45c64fd6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:24.338622 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f1585d7c-92d0-493c-a77b-bb2a45c64fd6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:24.345224 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f1585d7c-92d0-493c-a77b-bb2a45c64fd6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:24.345788 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f1585d7c-92d0-493c-a77b-bb2a45c64fd6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:24.347024 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f1585d7c-92d0-493c-a77b-bb2a45c64fd6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:24.347610 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f1585d7c-92d0-493c-a77b-bb2a45c64fd6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:24.438869 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-f32f52c1-042d-422b-8af0-d0aed49bf44f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:24.447262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f32f52c1-042d-422b-8af0-d0aed49bf44f tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 0.164861 Jun 16 17:23:24.447818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 55/107] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:24 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:24.491416 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f1585d7c-92d0-493c-a77b-bb2a45c64fd6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:24.501734 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f1585d7c-92d0-493c-a77b-bb2a45c64fd6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 0.169186 Jun 16 17:23:24.502300 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 53/108] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:24 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:24.706662 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-26a22dfe-b71d-4268-9e30-fada0ea2f6ac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:24.707258 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-26a22dfe-b71d-4268-9e30-fada0ea2f6ac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:24.713818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-26a22dfe-b71d-4268-9e30-fada0ea2f6ac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:24.714252 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-26a22dfe-b71d-4268-9e30-fada0ea2f6ac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:24.714998 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-26a22dfe-b71d-4268-9e30-fada0ea2f6ac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:24.715413 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-26a22dfe-b71d-4268-9e30-fada0ea2f6ac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:24.810068 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-40bf0984-804e-4dc4-9d9c-51d4c99730f4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:24.810698 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-40bf0984-804e-4dc4-9d9c-51d4c99730f4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:24.817065 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-40bf0984-804e-4dc4-9d9c-51d4c99730f4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:24.817563 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-40bf0984-804e-4dc4-9d9c-51d4c99730f4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:24.818352 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-40bf0984-804e-4dc4-9d9c-51d4c99730f4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:24.818826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-40bf0984-804e-4dc4-9d9c-51d4c99730f4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:24.860910 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-26a22dfe-b71d-4268-9e30-fada0ea2f6ac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:24.864545 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=100 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:24.869526 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-26a22dfe-b71d-4268-9e30-fada0ea2f6ac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:24.871007 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-26a22dfe-b71d-4268-9e30-fada0ea2f6ac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:24.872103 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-26a22dfe-b71d-4268-9e30-fada0ea2f6ac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.169652 Jun 16 17:23:24.872650 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 56/109] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:24 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:24.952640 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-40bf0984-804e-4dc4-9d9c-51d4c99730f4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:24.960415 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-40bf0984-804e-4dc4-9d9c-51d4c99730f4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.154280 Jun 16 17:23:24.960978 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 54/110] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:24 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:25.212581 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-99f889dc-3164-4ad6-8811-043c3adad71d req-aeb533b8-9e99-4ed1-9472-f9f2c71f5910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2e7148-fa86-4648-9e4b-87e27fcf1147", "name": "network-vif-plugged", "status": "completed", "tag": "2da50d5c-d328-4853-a261-6bd0c6378dcd"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:23:25.221629 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-99f889dc-3164-4ad6-8811-043c3adad71d req-aeb533b8-9e99-4ed1-9472-f9f2c71f5910 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:25.222069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-99f889dc-3164-4ad6-8811-043c3adad71d req-aeb533b8-9e99-4ed1-9472-f9f2c71f5910 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:25.233721 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-99f889dc-3164-4ad6-8811-043c3adad71d req-aeb533b8-9e99-4ed1-9472-f9f2c71f5910 service nova] Creating event network-vif-plugged:2da50d5c-d328-4853-a261-6bd0c6378dcd for instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 on hv-cinder-83735 Jun 16 17:23:25.239249 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-99f889dc-3164-4ad6-8811-043c3adad71d req-aeb533b8-9e99-4ed1-9472-f9f2c71f5910 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030904 Jun 16 17:23:25.239869 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 57/111] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:23:25.465475 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ec3f53d3-2bb4-40b5-823c-ce48463bf7fb tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:25.467086 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ec3f53d3-2bb4-40b5-823c-ce48463bf7fb tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:25.475014 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ec3f53d3-2bb4-40b5-823c-ce48463bf7fb tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:25.475756 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ec3f53d3-2bb4-40b5-823c-ce48463bf7fb tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:25.477379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ec3f53d3-2bb4-40b5-823c-ce48463bf7fb tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:25.477994 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ec3f53d3-2bb4-40b5-823c-ce48463bf7fb tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:25.519988 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4081bb50-cdff-4a60-9379-30d121a160af tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:25.520654 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4081bb50-cdff-4a60-9379-30d121a160af tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:25.529016 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4081bb50-cdff-4a60-9379-30d121a160af tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:25.529766 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4081bb50-cdff-4a60-9379-30d121a160af tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:25.530755 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4081bb50-cdff-4a60-9379-30d121a160af tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:25.531406 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4081bb50-cdff-4a60-9379-30d121a160af tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:25.668960 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ec3f53d3-2bb4-40b5-823c-ce48463bf7fb tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:25.676656 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ec3f53d3-2bb4-40b5-823c-ce48463bf7fb tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1314 microversion: 2.1 time: 0.216286 Jun 16 17:23:25.677814 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 55/112] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:25 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:25.687708 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4081bb50-cdff-4a60-9379-30d121a160af tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:25.695756 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4081bb50-cdff-4a60-9379-30d121a160af tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1320 microversion: 2.1 time: 0.180588 Jun 16 17:23:25.696492 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 58/113] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:25 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1320 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:25.890575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-4b91472d-15c0-47bd-ae92-4dcfa59301f9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:25.891180 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-4b91472d-15c0-47bd-ae92-4dcfa59301f9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:25.897440 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4b91472d-15c0-47bd-ae92-4dcfa59301f9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:25.897882 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4b91472d-15c0-47bd-ae92-4dcfa59301f9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:25.898723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4b91472d-15c0-47bd-ae92-4dcfa59301f9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:25.899594 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4b91472d-15c0-47bd-ae92-4dcfa59301f9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:25.977659 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-918c8a8d-9290-4766-bbb5-d5beb86b8138 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:25.978364 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-918c8a8d-9290-4766-bbb5-d5beb86b8138 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:25.985626 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-918c8a8d-9290-4766-bbb5-d5beb86b8138 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:25.986228 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-918c8a8d-9290-4766-bbb5-d5beb86b8138 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:25.987396 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-918c8a8d-9290-4766-bbb5-d5beb86b8138 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:25.987904 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-918c8a8d-9290-4766-bbb5-d5beb86b8138 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:26.042405 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-4b91472d-15c0-47bd-ae92-4dcfa59301f9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:26.051409 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-4b91472d-15c0-47bd-ae92-4dcfa59301f9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:26.052894 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-4b91472d-15c0-47bd-ae92-4dcfa59301f9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:26.054038 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-4b91472d-15c0-47bd-ae92-4dcfa59301f9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.167616 Jun 16 17:23:26.059659 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 56/114] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:25 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:26.162540 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-918c8a8d-9290-4766-bbb5-d5beb86b8138 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:26.170588 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-918c8a8d-9290-4766-bbb5-d5beb86b8138 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.197186 Jun 16 17:23:26.171233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 59/115] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:25 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:26.694077 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-90418f56-5ece-47db-8c7f-1a0fecd57985 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:26.694683 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-90418f56-5ece-47db-8c7f-1a0fecd57985 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:26.703723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-90418f56-5ece-47db-8c7f-1a0fecd57985 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:26.705237 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-90418f56-5ece-47db-8c7f-1a0fecd57985 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:26.706049 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-90418f56-5ece-47db-8c7f-1a0fecd57985 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:26.706552 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-90418f56-5ece-47db-8c7f-1a0fecd57985 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:26.714141 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-cde549b7-fc1a-4133-98dc-553d68c02596 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:26.715607 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-cde549b7-fc1a-4133-98dc-553d68c02596 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:26.729412 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cde549b7-fc1a-4133-98dc-553d68c02596 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:26.729858 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cde549b7-fc1a-4133-98dc-553d68c02596 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:26.730638 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cde549b7-fc1a-4133-98dc-553d68c02596 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:26.731374 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cde549b7-fc1a-4133-98dc-553d68c02596 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:26.932294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-90418f56-5ece-47db-8c7f-1a0fecd57985 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:26.940606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-90418f56-5ece-47db-8c7f-1a0fecd57985 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1502 microversion: 2.1 time: 0.250231 Jun 16 17:23:26.941901 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 57/116] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:26 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1502 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:26.983657 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-cde549b7-fc1a-4133-98dc-553d68c02596 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:26.993472 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-cde549b7-fc1a-4133-98dc-553d68c02596 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1515 microversion: 2.1 time: 0.284941 Jun 16 17:23:26.994404 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 60/117] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:26 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1515 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:27.010401 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-86b61205-edc3-475a-bf8b-5eb6e65152c2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:23:27.011548 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-86b61205-edc3-475a-bf8b-5eb6e65152c2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:27.018343 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-86b61205-edc3-475a-bf8b-5eb6e65152c2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:27.018948 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-86b61205-edc3-475a-bf8b-5eb6e65152c2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:27.019799 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-86b61205-edc3-475a-bf8b-5eb6e65152c2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:27.020376 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-86b61205-edc3-475a-bf8b-5eb6e65152c2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:27.096669 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-11c8213e-eeba-47ef-8b2a-5a106e47ab13 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:27.097610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-11c8213e-eeba-47ef-8b2a-5a106e47ab13 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:27.106890 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-11c8213e-eeba-47ef-8b2a-5a106e47ab13 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:27.107590 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-11c8213e-eeba-47ef-8b2a-5a106e47ab13 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:27.108143 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.objects.instance [None req-86b61205-edc3-475a-bf8b-5eb6e65152c2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lazy-loading 'flavor' on Instance uuid 75957299-3d36-4f9c-a081-9e621c88225c {{(pid=117552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:23:27.108657 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-11c8213e-eeba-47ef-8b2a-5a106e47ab13 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:27.109210 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-11c8213e-eeba-47ef-8b2a-5a106e47ab13 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:27.218773 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:27.271601 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-86b61205-edc3-475a-bf8b-5eb6e65152c2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "POST /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c/action" status: 200 len: 32 microversion: 2.1 time: 0.264330 Jun 16 17:23:27.272399 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 58/118] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jun 16 17:23:27 2022] POST /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c/action => generated 32 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:23:27.285586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7da2fd0e-d9fd-4cfe-a278-68e8b04e7d64 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:27.286755 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7da2fd0e-d9fd-4cfe-a278-68e8b04e7d64 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:27.296086 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7da2fd0e-d9fd-4cfe-a278-68e8b04e7d64 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:27.297115 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7da2fd0e-d9fd-4cfe-a278-68e8b04e7d64 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:27.298227 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7da2fd0e-d9fd-4cfe-a278-68e8b04e7d64 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:27.298854 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7da2fd0e-d9fd-4cfe-a278-68e8b04e7d64 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:27.381022 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-11c8213e-eeba-47ef-8b2a-5a106e47ab13 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:27.389139 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-11c8213e-eeba-47ef-8b2a-5a106e47ab13 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:27.390795 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-11c8213e-eeba-47ef-8b2a-5a106e47ab13 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:27.393213 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-11c8213e-eeba-47ef-8b2a-5a106e47ab13 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.312453 Jun 16 17:23:27.394270 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 61/119] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:27 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:23:27.408474 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-e6fd00af-32e6-4836-bde7-0056d1820869 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:27.409559 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-e6fd00af-32e6-4836-bde7-0056d1820869 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:27.417812 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e6fd00af-32e6-4836-bde7-0056d1820869 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:27.418807 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e6fd00af-32e6-4836-bde7-0056d1820869 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:27.419763 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e6fd00af-32e6-4836-bde7-0056d1820869 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:27.421898 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e6fd00af-32e6-4836-bde7-0056d1820869 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:27.553976 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7da2fd0e-d9fd-4cfe-a278-68e8b04e7d64 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:27.562675 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7da2fd0e-d9fd-4cfe-a278-68e8b04e7d64 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.288889 Jun 16 17:23:27.563258 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 59/120] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:27 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:27.569500 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-f1d9e399-74a0-408d-90d6-cef31e5e962a req-2db80985-6850-4d6f-971a-d40300e3ac15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d22b60d-19fe-4dca-8eef-821db5a4dc55", "name": "network-vif-plugged", "status": "completed", "tag": "21fae4ca-fb3d-4b09-8071-928df2baff45"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:23:27.578402 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-f1d9e399-74a0-408d-90d6-cef31e5e962a req-2db80985-6850-4d6f-971a-d40300e3ac15 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:27.579070 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-f1d9e399-74a0-408d-90d6-cef31e5e962a req-2db80985-6850-4d6f-971a-d40300e3ac15 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:27.590548 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-f1d9e399-74a0-408d-90d6-cef31e5e962a req-2db80985-6850-4d6f-971a-d40300e3ac15 service nova] Creating event network-vif-plugged:21fae4ca-fb3d-4b09-8071-928df2baff45 for instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 on hv-cinder-83735 Jun 16 17:23:27.595735 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-f1d9e399-74a0-408d-90d6-cef31e5e962a req-2db80985-6850-4d6f-971a-d40300e3ac15 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031248 Jun 16 17:23:27.596500 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 60/121] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:23:27.672620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e6fd00af-32e6-4836-bde7-0056d1820869 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:27.681118 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-e6fd00af-32e6-4836-bde7-0056d1820869 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.285563 Jun 16 17:23:27.681856 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 62/122] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:27 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:28.411932 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d5afaeb9-f658-4a6b-9f12-c45dbfe1f43a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:28.412607 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d5afaeb9-f658-4a6b-9f12-c45dbfe1f43a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:28.419372 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d5afaeb9-f658-4a6b-9f12-c45dbfe1f43a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:28.419809 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d5afaeb9-f658-4a6b-9f12-c45dbfe1f43a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:28.420671 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d5afaeb9-f658-4a6b-9f12-c45dbfe1f43a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:28.421098 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d5afaeb9-f658-4a6b-9f12-c45dbfe1f43a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:28.571975 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d5afaeb9-f658-4a6b-9f12-c45dbfe1f43a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:28.581303 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d5afaeb9-f658-4a6b-9f12-c45dbfe1f43a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:28.581459 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2d231b01-2204-4289-b3e7-76685f62028e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:28.581961 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2d231b01-2204-4289-b3e7-76685f62028e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:28.584073 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d5afaeb9-f658-4a6b-9f12-c45dbfe1f43a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:28.585934 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d5afaeb9-f658-4a6b-9f12-c45dbfe1f43a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.178045 Jun 16 17:23:28.586980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 61/123] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:28 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:28.597383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=83 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:28.597383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2d231b01-2204-4289-b3e7-76685f62028e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:28.597383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2d231b01-2204-4289-b3e7-76685f62028e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:28.597383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2d231b01-2204-4289-b3e7-76685f62028e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:28.597773 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2d231b01-2204-4289-b3e7-76685f62028e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:28.698336 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-60433a32-5234-490c-9b7f-f02e332a7293 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:28.698933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-60433a32-5234-490c-9b7f-f02e332a7293 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:28.705906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-60433a32-5234-490c-9b7f-f02e332a7293 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:28.706574 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-60433a32-5234-490c-9b7f-f02e332a7293 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:28.707595 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-60433a32-5234-490c-9b7f-f02e332a7293 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:28.708177 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-60433a32-5234-490c-9b7f-f02e332a7293 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:28.750862 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2d231b01-2204-4289-b3e7-76685f62028e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:28.771916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2d231b01-2204-4289-b3e7-76685f62028e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.195597 Jun 16 17:23:28.772591 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 63/124] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:28 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:28.868414 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-60433a32-5234-490c-9b7f-f02e332a7293 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:28.876661 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-60433a32-5234-490c-9b7f-f02e332a7293 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.182751 Jun 16 17:23:28.877436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 62/125] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:28 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:29.605745 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d5e6cf3a-753e-481c-8357-217d51f2c1bd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:29.606747 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-d5e6cf3a-753e-481c-8357-217d51f2c1bd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:29.613084 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d5e6cf3a-753e-481c-8357-217d51f2c1bd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:29.613608 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d5e6cf3a-753e-481c-8357-217d51f2c1bd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:29.614444 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d5e6cf3a-753e-481c-8357-217d51f2c1bd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:29.614908 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d5e6cf3a-753e-481c-8357-217d51f2c1bd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:29.781609 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d5e6cf3a-753e-481c-8357-217d51f2c1bd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:29.794514 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-915e2d2a-8127-4e1c-ae6c-281cefa42046 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:29.795126 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-915e2d2a-8127-4e1c-ae6c-281cefa42046 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:29.799896 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d5e6cf3a-753e-481c-8357-217d51f2c1bd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:29.801598 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d5e6cf3a-753e-481c-8357-217d51f2c1bd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:29.802745 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-d5e6cf3a-753e-481c-8357-217d51f2c1bd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.201530 Jun 16 17:23:29.803295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 64/126] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:29 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:29.805522 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-915e2d2a-8127-4e1c-ae6c-281cefa42046 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:29.806015 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-915e2d2a-8127-4e1c-ae6c-281cefa42046 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:29.806787 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-915e2d2a-8127-4e1c-ae6c-281cefa42046 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:29.807272 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-915e2d2a-8127-4e1c-ae6c-281cefa42046 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:29.893978 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-44d455ac-75bf-46f2-8a2d-036750fc58b9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:29.894581 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-44d455ac-75bf-46f2-8a2d-036750fc58b9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:29.900988 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-44d455ac-75bf-46f2-8a2d-036750fc58b9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:29.901471 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-44d455ac-75bf-46f2-8a2d-036750fc58b9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:29.902242 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-44d455ac-75bf-46f2-8a2d-036750fc58b9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:29.902668 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-44d455ac-75bf-46f2-8a2d-036750fc58b9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:29.939970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-915e2d2a-8127-4e1c-ae6c-281cefa42046 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:29.948013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-915e2d2a-8127-4e1c-ae6c-281cefa42046 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.159750 Jun 16 17:23:29.948587 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 63/127] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:29 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:30.042144 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-44d455ac-75bf-46f2-8a2d-036750fc58b9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:30.050876 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-44d455ac-75bf-46f2-8a2d-036750fc58b9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.160611 Jun 16 17:23:30.051879 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 65/128] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:29 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:30.823605 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f19a1871-26d3-46fa-9431-ea4a6dc6f74f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:30.824147 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f19a1871-26d3-46fa-9431-ea4a6dc6f74f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:30.832074 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f19a1871-26d3-46fa-9431-ea4a6dc6f74f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:30.832696 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f19a1871-26d3-46fa-9431-ea4a6dc6f74f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:30.833844 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f19a1871-26d3-46fa-9431-ea4a6dc6f74f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:30.834254 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f19a1871-26d3-46fa-9431-ea4a6dc6f74f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:30.966182 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ccb94463-c1d2-4a68-929f-48956c4cf080 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:30.966803 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ccb94463-c1d2-4a68-929f-48956c4cf080 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:30.973048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ccb94463-c1d2-4a68-929f-48956c4cf080 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:30.973517 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ccb94463-c1d2-4a68-929f-48956c4cf080 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:30.974532 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ccb94463-c1d2-4a68-929f-48956c4cf080 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:30.978217 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f19a1871-26d3-46fa-9431-ea4a6dc6f74f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:30.984790 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ccb94463-c1d2-4a68-929f-48956c4cf080 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:30.992008 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f19a1871-26d3-46fa-9431-ea4a6dc6f74f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:30.994253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f19a1871-26d3-46fa-9431-ea4a6dc6f74f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:30.995366 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f19a1871-26d3-46fa-9431-ea4a6dc6f74f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.176792 Jun 16 17:23:30.995912 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 64/129] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:30 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:31.070096 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b2f4959b-4d55-49a0-907e-a1d5ba30933a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:31.070728 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b2f4959b-4d55-49a0-907e-a1d5ba30933a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:31.076986 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b2f4959b-4d55-49a0-907e-a1d5ba30933a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:31.077728 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b2f4959b-4d55-49a0-907e-a1d5ba30933a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:31.078521 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b2f4959b-4d55-49a0-907e-a1d5ba30933a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:31.078944 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b2f4959b-4d55-49a0-907e-a1d5ba30933a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:31.150247 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ccb94463-c1d2-4a68-929f-48956c4cf080 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:31.157951 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ccb94463-c1d2-4a68-929f-48956c4cf080 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.195874 Jun 16 17:23:31.158892 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 66/130] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:30 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:31.219364 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-b2f4959b-4d55-49a0-907e-a1d5ba30933a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:31.227055 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b2f4959b-4d55-49a0-907e-a1d5ba30933a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.160583 Jun 16 17:23:31.227618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 65/131] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:31 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:32.014126 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d3853611-4cee-480c-9d9b-76b7af4c9980 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:32.014699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-d3853611-4cee-480c-9d9b-76b7af4c9980 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:32.021120 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d3853611-4cee-480c-9d9b-76b7af4c9980 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:32.021587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d3853611-4cee-480c-9d9b-76b7af4c9980 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:32.022333 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d3853611-4cee-480c-9d9b-76b7af4c9980 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:32.022751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d3853611-4cee-480c-9d9b-76b7af4c9980 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:32.173755 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d3853611-4cee-480c-9d9b-76b7af4c9980 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:32.175804 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-2ca8db61-4219-4413-87e9-c253b92366c6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:32.177026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-2ca8db61-4219-4413-87e9-c253b92366c6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:32.184073 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d3853611-4cee-480c-9d9b-76b7af4c9980 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:32.186056 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d3853611-4cee-480c-9d9b-76b7af4c9980 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:32.186549 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2ca8db61-4219-4413-87e9-c253b92366c6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:32.187376 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-d3853611-4cee-480c-9d9b-76b7af4c9980 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.177160 Jun 16 17:23:32.187750 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2ca8db61-4219-4413-87e9-c253b92366c6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:32.189334 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 67/132] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:32 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:32.189570 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2ca8db61-4219-4413-87e9-c253b92366c6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:32.189570 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2ca8db61-4219-4413-87e9-c253b92366c6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:32.245730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ff24dc22-ac33-44c5-a015-4e677a32791a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:32.246615 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ff24dc22-ac33-44c5-a015-4e677a32791a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:32.253313 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ff24dc22-ac33-44c5-a015-4e677a32791a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:32.253842 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ff24dc22-ac33-44c5-a015-4e677a32791a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:32.254698 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ff24dc22-ac33-44c5-a015-4e677a32791a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:32.255199 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ff24dc22-ac33-44c5-a015-4e677a32791a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:32.345819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2ca8db61-4219-4413-87e9-c253b92366c6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:32.354815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-2ca8db61-4219-4413-87e9-c253b92366c6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.184204 Jun 16 17:23:32.355407 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 66/133] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:32 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:32.416416 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ff24dc22-ac33-44c5-a015-4e677a32791a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:32.426821 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ff24dc22-ac33-44c5-a015-4e677a32791a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.185252 Jun 16 17:23:32.427598 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 68/134] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:32 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:33.209546 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-002f3314-71ee-460d-b966-2c30c9db56f3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:33.210016 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-002f3314-71ee-460d-b966-2c30c9db56f3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:33.216576 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-002f3314-71ee-460d-b966-2c30c9db56f3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:33.217312 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-002f3314-71ee-460d-b966-2c30c9db56f3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:33.218064 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-002f3314-71ee-460d-b966-2c30c9db56f3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:33.218487 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-002f3314-71ee-460d-b966-2c30c9db56f3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:33.371574 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-002f3314-71ee-460d-b966-2c30c9db56f3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:33.374786 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-080b683d-df4b-45a9-811d-4a4649f0f79f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:33.375399 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-080b683d-df4b-45a9-811d-4a4649f0f79f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:33.383752 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-002f3314-71ee-460d-b966-2c30c9db56f3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:33.383966 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-080b683d-df4b-45a9-811d-4a4649f0f79f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:33.384598 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-080b683d-df4b-45a9-811d-4a4649f0f79f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:33.385758 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-080b683d-df4b-45a9-811d-4a4649f0f79f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:33.385946 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-002f3314-71ee-460d-b966-2c30c9db56f3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:33.386381 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-080b683d-df4b-45a9-811d-4a4649f0f79f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:33.387544 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-002f3314-71ee-460d-b966-2c30c9db56f3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.181742 Jun 16 17:23:33.388249 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 67/135] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:33 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:33.445425 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7bc3caf8-b778-41fa-8aeb-c6a9a932f9d0 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:33.446145 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7bc3caf8-b778-41fa-8aeb-c6a9a932f9d0 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:33.452540 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7bc3caf8-b778-41fa-8aeb-c6a9a932f9d0 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:33.452977 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7bc3caf8-b778-41fa-8aeb-c6a9a932f9d0 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:33.453793 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7bc3caf8-b778-41fa-8aeb-c6a9a932f9d0 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:33.454204 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7bc3caf8-b778-41fa-8aeb-c6a9a932f9d0 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:33.529341 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-080b683d-df4b-45a9-811d-4a4649f0f79f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:33.536942 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-080b683d-df4b-45a9-811d-4a4649f0f79f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.167473 Jun 16 17:23:33.537714 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 69/136] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:33 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:33.584049 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7bc3caf8-b778-41fa-8aeb-c6a9a932f9d0 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:33.592019 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7bc3caf8-b778-41fa-8aeb-c6a9a932f9d0 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.150618 Jun 16 17:23:33.592617 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 68/137] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:33 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:34.408961 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c3e0532f-621d-4371-b1b5-96eead22acd3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:34.409582 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c3e0532f-621d-4371-b1b5-96eead22acd3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:34.418033 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c3e0532f-621d-4371-b1b5-96eead22acd3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:34.419844 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c3e0532f-621d-4371-b1b5-96eead22acd3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:34.419844 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c3e0532f-621d-4371-b1b5-96eead22acd3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:34.419844 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c3e0532f-621d-4371-b1b5-96eead22acd3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:34.554028 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f86d4dcf-c310-4ec4-9863-87a29fcc2487 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:34.554583 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f86d4dcf-c310-4ec4-9863-87a29fcc2487 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:34.561846 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f86d4dcf-c310-4ec4-9863-87a29fcc2487 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:34.562448 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f86d4dcf-c310-4ec4-9863-87a29fcc2487 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:34.563620 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f86d4dcf-c310-4ec4-9863-87a29fcc2487 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:34.564212 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f86d4dcf-c310-4ec4-9863-87a29fcc2487 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:34.583182 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c3e0532f-621d-4371-b1b5-96eead22acd3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:34.594183 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c3e0532f-621d-4371-b1b5-96eead22acd3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:34.595824 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c3e0532f-621d-4371-b1b5-96eead22acd3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:34.596940 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c3e0532f-621d-4371-b1b5-96eead22acd3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.192077 Jun 16 17:23:34.597528 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 70/138] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:34 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:34.609592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-60218092-915a-48c7-8fbc-0dd17032fb79 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:34.610294 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-60218092-915a-48c7-8fbc-0dd17032fb79 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:34.616857 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-60218092-915a-48c7-8fbc-0dd17032fb79 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:34.617316 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-60218092-915a-48c7-8fbc-0dd17032fb79 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:34.618086 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-60218092-915a-48c7-8fbc-0dd17032fb79 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:34.618507 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-60218092-915a-48c7-8fbc-0dd17032fb79 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:34.798017 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-60218092-915a-48c7-8fbc-0dd17032fb79 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:34.807389 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-60218092-915a-48c7-8fbc-0dd17032fb79 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.201960 Jun 16 17:23:34.809871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 71/139] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:34 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:34.875081 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-bc6e0b8f-f888-4121-bc7b-d7bc6fd7b509 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17672ec1-c4e6-4172-a743-b74b639aa094"}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:23:34.876320 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-bc6e0b8f-f888-4121-bc7b-d7bc6fd7b509 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:34.885915 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bc6e0b8f-f888-4121-bc7b-d7bc6fd7b509 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:34.886385 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bc6e0b8f-f888-4121-bc7b-d7bc6fd7b509 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:34.887174 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bc6e0b8f-f888-4121-bc7b-d7bc6fd7b509 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:34.887597 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bc6e0b8f-f888-4121-bc7b-d7bc6fd7b509 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:34.943473 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f86d4dcf-c310-4ec4-9863-87a29fcc2487 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:34.951008 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f86d4dcf-c310-4ec4-9863-87a29fcc2487 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.400890 Jun 16 17:23:34.960534 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 69/140] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:34 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:35.614963 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0376e25e-fda2-4c59-a572-e198a8313424 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:35.615620 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0376e25e-fda2-4c59-a572-e198a8313424 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:35.622572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0376e25e-fda2-4c59-a572-e198a8313424 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:35.623003 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0376e25e-fda2-4c59-a572-e198a8313424 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:35.623778 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0376e25e-fda2-4c59-a572-e198a8313424 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:35.624209 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0376e25e-fda2-4c59-a572-e198a8313424 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:35.774859 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0376e25e-fda2-4c59-a572-e198a8313424 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:35.783377 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0376e25e-fda2-4c59-a572-e198a8313424 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:35.784847 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0376e25e-fda2-4c59-a572-e198a8313424 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:35.785968 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0376e25e-fda2-4c59-a572-e198a8313424 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.175068 Jun 16 17:23:35.786522 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 70/141] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:35 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:35.828922 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f4a6b1d0-0d28-4198-803f-ff75b7c00e72 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:35.829803 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f4a6b1d0-0d28-4198-803f-ff75b7c00e72 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:35.838870 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f4a6b1d0-0d28-4198-803f-ff75b7c00e72 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:35.839505 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f4a6b1d0-0d28-4198-803f-ff75b7c00e72 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:35.840651 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f4a6b1d0-0d28-4198-803f-ff75b7c00e72 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:35.841316 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f4a6b1d0-0d28-4198-803f-ff75b7c00e72 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:35.991712 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f4a6b1d0-0d28-4198-803f-ff75b7c00e72 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:36.003841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f4a6b1d0-0d28-4198-803f-ff75b7c00e72 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.180184 Jun 16 17:23:36.004650 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 71/142] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:35 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:36.009208 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0b4bdc88-67f4-4102-8a68-b886eb7cdc26 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:36.009816 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0b4bdc88-67f4-4102-8a68-b886eb7cdc26 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:36.015663 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0b4bdc88-67f4-4102-8a68-b886eb7cdc26 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:36.016104 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0b4bdc88-67f4-4102-8a68-b886eb7cdc26 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:36.016873 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0b4bdc88-67f4-4102-8a68-b886eb7cdc26 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:36.017403 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0b4bdc88-67f4-4102-8a68-b886eb7cdc26 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:36.148974 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0b4bdc88-67f4-4102-8a68-b886eb7cdc26 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:36.156953 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0b4bdc88-67f4-4102-8a68-b886eb7cdc26 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.150993 Jun 16 17:23:36.157136 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 72/143] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:36 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:36.806306 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-72226053-b04b-4834-9a91-842c1200d605 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:36.807082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-72226053-b04b-4834-9a91-842c1200d605 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:36.808931 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=96 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:36.814491 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-72226053-b04b-4834-9a91-842c1200d605 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:36.814929 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-72226053-b04b-4834-9a91-842c1200d605 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:36.815683 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-72226053-b04b-4834-9a91-842c1200d605 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:36.816105 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-72226053-b04b-4834-9a91-842c1200d605 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:36.950392 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-72226053-b04b-4834-9a91-842c1200d605 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:36.962173 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-72226053-b04b-4834-9a91-842c1200d605 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:36.963735 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-72226053-b04b-4834-9a91-842c1200d605 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:36.964876 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-72226053-b04b-4834-9a91-842c1200d605 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.163611 Jun 16 17:23:36.965780 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 73/144] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:36 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:37.022123 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b757bc3e-7283-4a03-88f7-a6d78df24dfa tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:37.022747 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b757bc3e-7283-4a03-88f7-a6d78df24dfa tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:37.029254 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b757bc3e-7283-4a03-88f7-a6d78df24dfa tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:37.029694 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b757bc3e-7283-4a03-88f7-a6d78df24dfa tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:37.030454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b757bc3e-7283-4a03-88f7-a6d78df24dfa tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:37.030989 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b757bc3e-7283-4a03-88f7-a6d78df24dfa tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:37.190825 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-b757bc3e-7283-4a03-88f7-a6d78df24dfa tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:37.201445 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b757bc3e-7283-4a03-88f7-a6d78df24dfa tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.183218 Jun 16 17:23:37.202427 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 74/145] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:37 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:37.212040 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-aa65a79a-708f-4422-8142-6e1a0b57fee7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:37.213528 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-aa65a79a-708f-4422-8142-6e1a0b57fee7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:37.221471 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-aa65a79a-708f-4422-8142-6e1a0b57fee7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:37.221923 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-aa65a79a-708f-4422-8142-6e1a0b57fee7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:37.222699 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-aa65a79a-708f-4422-8142-6e1a0b57fee7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:37.223125 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-aa65a79a-708f-4422-8142-6e1a0b57fee7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:37.240708 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:37.382164 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-aa65a79a-708f-4422-8142-6e1a0b57fee7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:37.397847 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-aa65a79a-708f-4422-8142-6e1a0b57fee7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.193697 Jun 16 17:23:37.398733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 75/146] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:37 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:37.790683 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:37.801856 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-bc6e0b8f-f888-4121-bc7b-d7bc6fd7b509 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "POST /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.930815 Jun 16 17:23:37.802497 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 72/147] 10.222.0.66 () {60 vars in 1322 bytes} [Thu Jun 16 17:23:34 2022] POST /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c/os-volume_attachments => generated 194 bytes in 2932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:23:37.984873 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7d270f5a-310e-4979-b9b9-08c682db5cc8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:37.985502 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7d270f5a-310e-4979-b9b9-08c682db5cc8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:37.991810 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7d270f5a-310e-4979-b9b9-08c682db5cc8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:37.992314 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7d270f5a-310e-4979-b9b9-08c682db5cc8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:37.993188 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7d270f5a-310e-4979-b9b9-08c682db5cc8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:37.993673 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7d270f5a-310e-4979-b9b9-08c682db5cc8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:38.228012 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8d5e89dc-2b67-468c-82bb-ddf5fe5e8dba tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:38.228768 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7d270f5a-310e-4979-b9b9-08c682db5cc8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:38.229475 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-8d5e89dc-2b67-468c-82bb-ddf5fe5e8dba tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:38.253858 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8d5e89dc-2b67-468c-82bb-ddf5fe5e8dba tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:38.257816 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8d5e89dc-2b67-468c-82bb-ddf5fe5e8dba tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:38.260471 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8d5e89dc-2b67-468c-82bb-ddf5fe5e8dba tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:38.262450 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8d5e89dc-2b67-468c-82bb-ddf5fe5e8dba tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:38.268735 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7d270f5a-310e-4979-b9b9-08c682db5cc8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:38.279401 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7d270f5a-310e-4979-b9b9-08c682db5cc8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:38.290024 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7d270f5a-310e-4979-b9b9-08c682db5cc8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1404 microversion: 2.20 time: 0.300584 Jun 16 17:23:38.301812 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 76/148] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:37 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1404 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:38.417879 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b179be59-1501-404a-9cc4-96525ff4bc7e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:38.418713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b179be59-1501-404a-9cc4-96525ff4bc7e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:38.430649 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b179be59-1501-404a-9cc4-96525ff4bc7e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:38.431219 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b179be59-1501-404a-9cc4-96525ff4bc7e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:38.432283 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b179be59-1501-404a-9cc4-96525ff4bc7e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:38.432809 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b179be59-1501-404a-9cc4-96525ff4bc7e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:38.560121 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8d5e89dc-2b67-468c-82bb-ddf5fe5e8dba tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:38.574748 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8d5e89dc-2b67-468c-82bb-ddf5fe5e8dba tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.350939 Jun 16 17:23:38.574748 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 73/149] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:38 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:38.635004 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-b179be59-1501-404a-9cc4-96525ff4bc7e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:38.651247 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b179be59-1501-404a-9cc4-96525ff4bc7e tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.238126 Jun 16 17:23:38.662522 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 77/150] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:38 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:39.318841 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a3b0bd94-d7a6-43f6-b026-5c3ad07b2035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:39.319455 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a3b0bd94-d7a6-43f6-b026-5c3ad07b2035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:39.327715 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a3b0bd94-d7a6-43f6-b026-5c3ad07b2035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:39.328154 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a3b0bd94-d7a6-43f6-b026-5c3ad07b2035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:39.328924 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a3b0bd94-d7a6-43f6-b026-5c3ad07b2035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:39.329394 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a3b0bd94-d7a6-43f6-b026-5c3ad07b2035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:39.506185 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a3b0bd94-d7a6-43f6-b026-5c3ad07b2035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:39.515633 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a3b0bd94-d7a6-43f6-b026-5c3ad07b2035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:39.517146 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a3b0bd94-d7a6-43f6-b026-5c3ad07b2035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:39.518336 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a3b0bd94-d7a6-43f6-b026-5c3ad07b2035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1596 microversion: 2.20 time: 0.203637 Jun 16 17:23:39.518867 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 74/151] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:23:39 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1596 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:23:39.537560 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0ac318c4-b292-4c0e-a5ea-7008e4e3312f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:39.538122 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0ac318c4-b292-4c0e-a5ea-7008e4e3312f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:39.544736 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0ac318c4-b292-4c0e-a5ea-7008e4e3312f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:39.545162 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0ac318c4-b292-4c0e-a5ea-7008e4e3312f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:39.545939 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0ac318c4-b292-4c0e-a5ea-7008e4e3312f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:39.546352 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0ac318c4-b292-4c0e-a5ea-7008e4e3312f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:39.596020 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-17e110d3-9849-48e0-b965-0ec874c20739 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:39.596725 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-17e110d3-9849-48e0-b965-0ec874c20739 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:39.603919 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-17e110d3-9849-48e0-b965-0ec874c20739 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:39.604451 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-17e110d3-9849-48e0-b965-0ec874c20739 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:39.605311 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-17e110d3-9849-48e0-b965-0ec874c20739 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:39.605813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-17e110d3-9849-48e0-b965-0ec874c20739 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:39.629767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0ac318c4-b292-4c0e-a5ea-7008e4e3312f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096295 Jun 16 17:23:39.631009 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 78/152] 10.222.0.66 () {60 vars in 1315 bytes} [Thu Jun 16 17:23:39 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:23:39.673192 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e25b45ad-d162-4daf-a89a-c223f17fe828 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:39.678400 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e25b45ad-d162-4daf-a89a-c223f17fe828 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:39.681274 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e25b45ad-d162-4daf-a89a-c223f17fe828 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:39.682036 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e25b45ad-d162-4daf-a89a-c223f17fe828 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:39.683223 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e25b45ad-d162-4daf-a89a-c223f17fe828 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:39.683762 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e25b45ad-d162-4daf-a89a-c223f17fe828 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:39.837606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-e25b45ad-d162-4daf-a89a-c223f17fe828 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:39.862334 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-e25b45ad-d162-4daf-a89a-c223f17fe828 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.195523 Jun 16 17:23:39.863048 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 79/153] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:39 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:39.988343 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-17e110d3-9849-48e0-b965-0ec874c20739 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:40.006005 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-17e110d3-9849-48e0-b965-0ec874c20739 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.413798 Jun 16 17:23:40.006881 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 75/154] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:39 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:40.880113 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-bc510ca3-6259-4dfb-9736-95e7afc36ba4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:40.880698 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-bc510ca3-6259-4dfb-9736-95e7afc36ba4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:40.887474 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bc510ca3-6259-4dfb-9736-95e7afc36ba4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:40.887918 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bc510ca3-6259-4dfb-9736-95e7afc36ba4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:40.888769 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bc510ca3-6259-4dfb-9736-95e7afc36ba4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:40.889203 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bc510ca3-6259-4dfb-9736-95e7afc36ba4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:41.025294 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ca6239c1-f23c-4db9-be96-8b44d9e18972 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:41.026514 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ca6239c1-f23c-4db9-be96-8b44d9e18972 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:41.034907 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-bc510ca3-6259-4dfb-9736-95e7afc36ba4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:41.035784 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ca6239c1-f23c-4db9-be96-8b44d9e18972 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:41.036290 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ca6239c1-f23c-4db9-be96-8b44d9e18972 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:41.037121 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ca6239c1-f23c-4db9-be96-8b44d9e18972 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:41.037685 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ca6239c1-f23c-4db9-be96-8b44d9e18972 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:41.053960 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-bc510ca3-6259-4dfb-9736-95e7afc36ba4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.177768 Jun 16 17:23:41.054730 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 80/155] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:40 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:41.283335 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ca6239c1-f23c-4db9-be96-8b44d9e18972 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:41.284868 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-2eb12601-b215-4a26-a896-0952fb94f632 req-8079fe7a-9577-4cfa-8f8e-ee7be42768fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab2e7148-fa86-4648-9e4b-87e27fcf1147", "tag": "2da50d5c-d328-4853-a261-6bd0c6378dcd"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:23:41.294180 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-2eb12601-b215-4a26-a896-0952fb94f632 req-8079fe7a-9577-4cfa-8f8e-ee7be42768fa service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:41.294595 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ca6239c1-f23c-4db9-be96-8b44d9e18972 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.272810 Jun 16 17:23:41.294849 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-2eb12601-b215-4a26-a896-0952fb94f632 req-8079fe7a-9577-4cfa-8f8e-ee7be42768fa service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:41.295548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 76/156] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:41 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:41.310775 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-2eb12601-b215-4a26-a896-0952fb94f632 req-8079fe7a-9577-4cfa-8f8e-ee7be42768fa service nova] Creating event network-changed:2da50d5c-d328-4853-a261-6bd0c6378dcd for instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 on hv-cinder-83735 Jun 16 17:23:41.319452 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-2eb12601-b215-4a26-a896-0952fb94f632 req-8079fe7a-9577-4cfa-8f8e-ee7be42768fa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038735 Jun 16 17:23:41.320864 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 81/157] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:23:42.071405 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-391d2338-52dd-4e02-86c7-712d9bd98840 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:42.071987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-391d2338-52dd-4e02-86c7-712d9bd98840 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:42.079047 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-391d2338-52dd-4e02-86c7-712d9bd98840 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:42.079486 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-391d2338-52dd-4e02-86c7-712d9bd98840 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:42.080252 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-391d2338-52dd-4e02-86c7-712d9bd98840 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:42.080678 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-391d2338-52dd-4e02-86c7-712d9bd98840 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:42.224570 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-391d2338-52dd-4e02-86c7-712d9bd98840 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:42.232910 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-391d2338-52dd-4e02-86c7-712d9bd98840 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.165611 Jun 16 17:23:42.233518 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 77/158] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:42 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:42.324594 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-289fb697-2c82-4806-8134-a15c43d39621 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:42.349457 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-289fb697-2c82-4806-8134-a15c43d39621 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:42.379381 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-289fb697-2c82-4806-8134-a15c43d39621 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:42.379804 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-289fb697-2c82-4806-8134-a15c43d39621 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:42.380557 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-289fb697-2c82-4806-8134-a15c43d39621 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:42.382807 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-289fb697-2c82-4806-8134-a15c43d39621 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:42.583739 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-289fb697-2c82-4806-8134-a15c43d39621 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:42.593693 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-289fb697-2c82-4806-8134-a15c43d39621 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.281286 Jun 16 17:23:42.594304 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 82/159] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:42 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:43.250037 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a0268790-f3ec-4939-be3c-c9f9be8d302f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:43.250597 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a0268790-f3ec-4939-be3c-c9f9be8d302f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:43.257663 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a0268790-f3ec-4939-be3c-c9f9be8d302f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:43.258210 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a0268790-f3ec-4939-be3c-c9f9be8d302f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:43.258993 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a0268790-f3ec-4939-be3c-c9f9be8d302f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:43.259423 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a0268790-f3ec-4939-be3c-c9f9be8d302f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:43.431448 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a0268790-f3ec-4939-be3c-c9f9be8d302f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:43.440297 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a0268790-f3ec-4939-be3c-c9f9be8d302f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1362 microversion: 2.1 time: 0.194081 Jun 16 17:23:43.441254 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 78/160] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:43 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:43.611843 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c0aa366f-59ab-4557-8fe2-55ecb3117bee tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:43.612447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c0aa366f-59ab-4557-8fe2-55ecb3117bee tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:43.618947 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c0aa366f-59ab-4557-8fe2-55ecb3117bee tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:43.619403 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c0aa366f-59ab-4557-8fe2-55ecb3117bee tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:43.620143 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c0aa366f-59ab-4557-8fe2-55ecb3117bee tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:43.620569 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c0aa366f-59ab-4557-8fe2-55ecb3117bee tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:43.825653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c0aa366f-59ab-4557-8fe2-55ecb3117bee tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:43.833517 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c0aa366f-59ab-4557-8fe2-55ecb3117bee tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.226034 Jun 16 17:23:43.834083 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 83/161] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:43 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:44.458400 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-30381e1c-cd27-49b2-bb2d-a559ac7ae674 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:44.458997 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-30381e1c-cd27-49b2-bb2d-a559ac7ae674 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:44.468744 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-30381e1c-cd27-49b2-bb2d-a559ac7ae674 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:44.479097 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-30381e1c-cd27-49b2-bb2d-a559ac7ae674 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:44.482369 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-30381e1c-cd27-49b2-bb2d-a559ac7ae674 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:44.492197 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-30381e1c-cd27-49b2-bb2d-a559ac7ae674 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:44.653137 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-30381e1c-cd27-49b2-bb2d-a559ac7ae674 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:44.660497 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-30381e1c-cd27-49b2-bb2d-a559ac7ae674 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1548 microversion: 2.1 time: 0.206159 Jun 16 17:23:44.661054 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 79/162] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:44 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1548 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:44.677574 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b3bb4fb4-dbe2-4e66-9513-ce038a7e80c6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:44.678358 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b3bb4fb4-dbe2-4e66-9513-ce038a7e80c6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:44.684776 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b3bb4fb4-dbe2-4e66-9513-ce038a7e80c6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:44.685322 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b3bb4fb4-dbe2-4e66-9513-ce038a7e80c6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:44.686076 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b3bb4fb4-dbe2-4e66-9513-ce038a7e80c6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:44.686494 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b3bb4fb4-dbe2-4e66-9513-ce038a7e80c6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:44.769336 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b3bb4fb4-dbe2-4e66-9513-ce038a7e80c6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095654 Jun 16 17:23:44.770038 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 84/163] 10.222.0.66 () {58 vars in 1274 bytes} [Thu Jun 16 17:23:44 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:23:44.851046 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-744e410a-9727-48d2-9ac5-71f77a552843 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:44.851720 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-744e410a-9727-48d2-9ac5-71f77a552843 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:44.858449 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-744e410a-9727-48d2-9ac5-71f77a552843 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:44.859153 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-744e410a-9727-48d2-9ac5-71f77a552843 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:44.859908 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-744e410a-9727-48d2-9ac5-71f77a552843 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:44.860331 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-744e410a-9727-48d2-9ac5-71f77a552843 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:45.105342 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-744e410a-9727-48d2-9ac5-71f77a552843 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:45.114108 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-744e410a-9727-48d2-9ac5-71f77a552843 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.267167 Jun 16 17:23:45.114997 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 80/164] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:44 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:46.131980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-382b3978-eace-4f3f-86fe-982edd75a7f1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:46.132727 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-382b3978-eace-4f3f-86fe-982edd75a7f1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:46.139656 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-382b3978-eace-4f3f-86fe-982edd75a7f1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:46.140103 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-382b3978-eace-4f3f-86fe-982edd75a7f1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:46.140857 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-382b3978-eace-4f3f-86fe-982edd75a7f1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:46.141322 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-382b3978-eace-4f3f-86fe-982edd75a7f1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:46.227898 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-6ae6c973-704b-4c70-9033-e5191400529e req-d7feb145-05f6-4699-86db-8d22f8335eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d22b60d-19fe-4dca-8eef-821db5a4dc55", "tag": "21fae4ca-fb3d-4b09-8071-928df2baff45"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:23:46.244685 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-6ae6c973-704b-4c70-9033-e5191400529e req-d7feb145-05f6-4699-86db-8d22f8335eb4 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:46.245918 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-6ae6c973-704b-4c70-9033-e5191400529e req-d7feb145-05f6-4699-86db-8d22f8335eb4 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:46.264904 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-6ae6c973-704b-4c70-9033-e5191400529e req-d7feb145-05f6-4699-86db-8d22f8335eb4 service nova] Creating event network-changed:21fae4ca-fb3d-4b09-8071-928df2baff45 for instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 on hv-cinder-83735 Jun 16 17:23:46.285882 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-6ae6c973-704b-4c70-9033-e5191400529e req-d7feb145-05f6-4699-86db-8d22f8335eb4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064665 Jun 16 17:23:46.287321 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 81/165] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:23:46.304168 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-382b3978-eace-4f3f-86fe-982edd75a7f1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:46.315979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-382b3978-eace-4f3f-86fe-982edd75a7f1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.187984 Jun 16 17:23:46.316883 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 85/166] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:46 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:47.333649 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4af3ffbc-dd4e-4395-85f4-52f2ad888cb0 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:47.335186 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4af3ffbc-dd4e-4395-85f4-52f2ad888cb0 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:47.345139 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4af3ffbc-dd4e-4395-85f4-52f2ad888cb0 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:47.345933 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4af3ffbc-dd4e-4395-85f4-52f2ad888cb0 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:47.346743 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4af3ffbc-dd4e-4395-85f4-52f2ad888cb0 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:47.347172 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4af3ffbc-dd4e-4395-85f4-52f2ad888cb0 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:47.620137 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4af3ffbc-dd4e-4395-85f4-52f2ad888cb0 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:47.628804 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4af3ffbc-dd4e-4395-85f4-52f2ad888cb0 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.299458 Jun 16 17:23:47.629412 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 82/167] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:47 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:48.648174 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-64225351-78db-46bc-88dc-2b042441ea5f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:48.648818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-64225351-78db-46bc-88dc-2b042441ea5f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:48.655651 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-64225351-78db-46bc-88dc-2b042441ea5f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:48.656346 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-64225351-78db-46bc-88dc-2b042441ea5f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:48.657085 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-64225351-78db-46bc-88dc-2b042441ea5f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:48.657550 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-64225351-78db-46bc-88dc-2b042441ea5f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:48.794906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-64225351-78db-46bc-88dc-2b042441ea5f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:48.804348 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-64225351-78db-46bc-88dc-2b042441ea5f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.159866 Jun 16 17:23:48.814804 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 86/168] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:48 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:49.822293 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-6ff8da28-5b51-4ab0-b014-2879276a1c55 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:49.822898 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-6ff8da28-5b51-4ab0-b014-2879276a1c55 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:49.830100 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6ff8da28-5b51-4ab0-b014-2879276a1c55 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:49.830541 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6ff8da28-5b51-4ab0-b014-2879276a1c55 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:49.831452 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6ff8da28-5b51-4ab0-b014-2879276a1c55 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:49.831809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6ff8da28-5b51-4ab0-b014-2879276a1c55 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:49.975208 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6ff8da28-5b51-4ab0-b014-2879276a1c55 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:49.984117 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-6ff8da28-5b51-4ab0-b014-2879276a1c55 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.166187 Jun 16 17:23:49.984689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 83/169] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:49 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:51.001762 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-aff72538-b2f6-4bf6-9ed8-4f0e76b38168 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:51.002339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-aff72538-b2f6-4bf6-9ed8-4f0e76b38168 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:51.008536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-aff72538-b2f6-4bf6-9ed8-4f0e76b38168 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:51.008977 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-aff72538-b2f6-4bf6-9ed8-4f0e76b38168 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:51.009787 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-aff72538-b2f6-4bf6-9ed8-4f0e76b38168 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:51.010222 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-aff72538-b2f6-4bf6-9ed8-4f0e76b38168 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:51.152765 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-aff72538-b2f6-4bf6-9ed8-4f0e76b38168 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:51.161313 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-aff72538-b2f6-4bf6-9ed8-4f0e76b38168 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.163282 Jun 16 17:23:51.161876 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 87/170] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:50 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:52.183757 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-9e3df957-ec64-466f-afe5-4a74287097d6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:52.184653 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-9e3df957-ec64-466f-afe5-4a74287097d6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:52.195061 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9e3df957-ec64-466f-afe5-4a74287097d6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:52.195632 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9e3df957-ec64-466f-afe5-4a74287097d6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:52.196430 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9e3df957-ec64-466f-afe5-4a74287097d6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:52.196855 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9e3df957-ec64-466f-afe5-4a74287097d6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:52.347453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-9e3df957-ec64-466f-afe5-4a74287097d6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:52.355635 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-9e3df957-ec64-466f-afe5-4a74287097d6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.179318 Jun 16 17:23:52.356217 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 84/171] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:52 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:53.374281 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c5e019b6-030e-4fac-a500-25a76f20ccbb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:53.375667 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c5e019b6-030e-4fac-a500-25a76f20ccbb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:53.382263 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c5e019b6-030e-4fac-a500-25a76f20ccbb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:53.382780 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c5e019b6-030e-4fac-a500-25a76f20ccbb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:53.384050 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c5e019b6-030e-4fac-a500-25a76f20ccbb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:53.384738 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c5e019b6-030e-4fac-a500-25a76f20ccbb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:53.544259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c5e019b6-030e-4fac-a500-25a76f20ccbb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:53.551882 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c5e019b6-030e-4fac-a500-25a76f20ccbb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.182136 Jun 16 17:23:53.552399 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 88/172] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:53 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:54.568440 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7481e5ac-5142-4582-be5e-e1e3837b92d2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:54.569778 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-7481e5ac-5142-4582-be5e-e1e3837b92d2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:54.576755 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7481e5ac-5142-4582-be5e-e1e3837b92d2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:54.577252 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7481e5ac-5142-4582-be5e-e1e3837b92d2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:54.578522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7481e5ac-5142-4582-be5e-e1e3837b92d2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:54.579308 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7481e5ac-5142-4582-be5e-e1e3837b92d2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:54.721373 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7481e5ac-5142-4582-be5e-e1e3837b92d2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:54.724284 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7481e5ac-5142-4582-be5e-e1e3837b92d2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.159351 Jun 16 17:23:54.725029 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 85/173] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:54 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:55.742451 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-46af9806-f21b-450e-ae5b-408f5f3267c6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:55.744253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-46af9806-f21b-450e-ae5b-408f5f3267c6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:55.750802 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-46af9806-f21b-450e-ae5b-408f5f3267c6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:55.751239 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-46af9806-f21b-450e-ae5b-408f5f3267c6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:55.752030 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-46af9806-f21b-450e-ae5b-408f5f3267c6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:55.752485 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-46af9806-f21b-450e-ae5b-408f5f3267c6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:55.899317 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-46af9806-f21b-450e-ae5b-408f5f3267c6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:55.908717 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-46af9806-f21b-450e-ae5b-408f5f3267c6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.170297 Jun 16 17:23:55.909319 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 89/174] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:55 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:56.030660 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-1f4e7ae5-fe37-4adb-8741-05ace3e70e08 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:56.031382 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-1f4e7ae5-fe37-4adb-8741-05ace3e70e08 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:56.037699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1f4e7ae5-fe37-4adb-8741-05ace3e70e08 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:56.038138 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1f4e7ae5-fe37-4adb-8741-05ace3e70e08 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:56.039001 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1f4e7ae5-fe37-4adb-8741-05ace3e70e08 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:56.039540 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1f4e7ae5-fe37-4adb-8741-05ace3e70e08 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:56.065909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-1f4e7ae5-fe37-4adb-8741-05ace3e70e08 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Going to try to terminate instance {{(pid=117553) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:23:56.159073 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-1f4e7ae5-fe37-4adb-8741-05ace3e70e08 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "DELETE /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 204 len: 0 microversion: 2.1 time: 0.132087 Jun 16 17:23:56.159846 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 86/175] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:23:56 2022] DELETE /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:23:56.168086 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-01d8ac5c-98f2-4852-a792-c7ecd3d1fb9a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:56.168937 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-01d8ac5c-98f2-4852-a792-c7ecd3d1fb9a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:56.175152 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-01d8ac5c-98f2-4852-a792-c7ecd3d1fb9a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:56.175848 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-01d8ac5c-98f2-4852-a792-c7ecd3d1fb9a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:56.176596 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-01d8ac5c-98f2-4852-a792-c7ecd3d1fb9a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:56.177295 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-01d8ac5c-98f2-4852-a792-c7ecd3d1fb9a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:56.364987 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-01d8ac5c-98f2-4852-a792-c7ecd3d1fb9a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:56.373127 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-01d8ac5c-98f2-4852-a792-c7ecd3d1fb9a tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1554 microversion: 2.1 time: 0.208975 Jun 16 17:23:56.373721 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 90/176] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:56 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1554 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:56.927027 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4d039b71-0672-454d-832c-3b2197120ba9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:56.927838 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4d039b71-0672-454d-832c-3b2197120ba9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:56.934397 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4d039b71-0672-454d-832c-3b2197120ba9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:56.934578 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4d039b71-0672-454d-832c-3b2197120ba9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:56.935334 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4d039b71-0672-454d-832c-3b2197120ba9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:56.935895 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4d039b71-0672-454d-832c-3b2197120ba9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:57.126882 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4d039b71-0672-454d-832c-3b2197120ba9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:57.135233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4d039b71-0672-454d-832c-3b2197120ba9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.212475 Jun 16 17:23:57.135723 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 87/177] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:56 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:23:57.391265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-70fe919c-a6c1-4c57-a631-160240bf39b1 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:57.391802 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-70fe919c-a6c1-4c57-a631-160240bf39b1 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:57.399851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-70fe919c-a6c1-4c57-a631-160240bf39b1 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:57.400294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-70fe919c-a6c1-4c57-a631-160240bf39b1 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:57.401083 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-70fe919c-a6c1-4c57-a631-160240bf39b1 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:57.401536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-70fe919c-a6c1-4c57-a631-160240bf39b1 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:57.551299 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-70fe919c-a6c1-4c57-a631-160240bf39b1 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:57.560222 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-70fe919c-a6c1-4c57-a631-160240bf39b1 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1554 microversion: 2.1 time: 0.172998 Jun 16 17:23:57.561061 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 91/178] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:57 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:58.152094 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-cf5f54dd-7aba-4929-9a6e-3c03453164a8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:58.153372 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-cf5f54dd-7aba-4929-9a6e-3c03453164a8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:58.159430 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cf5f54dd-7aba-4929-9a6e-3c03453164a8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:58.159935 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cf5f54dd-7aba-4929-9a6e-3c03453164a8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:58.160753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cf5f54dd-7aba-4929-9a6e-3c03453164a8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:58.161291 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cf5f54dd-7aba-4929-9a6e-3c03453164a8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:58.321661 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:58.442808 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-cf5f54dd-7aba-4929-9a6e-3c03453164a8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:58.451575 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-cf5f54dd-7aba-4929-9a6e-3c03453164a8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.303502 Jun 16 17:23:58.452123 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 88/179] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:58 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:58.579400 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-52a3aac2-b2d6-4330-84ac-c5341a83beb6 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:58.579986 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-52a3aac2-b2d6-4330-84ac-c5341a83beb6 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:58.586735 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-52a3aac2-b2d6-4330-84ac-c5341a83beb6 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:58.587217 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-52a3aac2-b2d6-4330-84ac-c5341a83beb6 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:58.588135 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-52a3aac2-b2d6-4330-84ac-c5341a83beb6 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:58.588576 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-52a3aac2-b2d6-4330-84ac-c5341a83beb6 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:58.753937 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-52a3aac2-b2d6-4330-84ac-c5341a83beb6 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:58.770803 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-52a3aac2-b2d6-4330-84ac-c5341a83beb6 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1554 microversion: 2.1 time: 0.195851 Jun 16 17:23:58.771383 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 92/180] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:58 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:59.468213 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c94acd9f-3220-4ccf-8e17-10fb7174c4a9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:59.469023 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c94acd9f-3220-4ccf-8e17-10fb7174c4a9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:59.473472 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:59.479496 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c94acd9f-3220-4ccf-8e17-10fb7174c4a9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:59.479939 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c94acd9f-3220-4ccf-8e17-10fb7174c4a9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:59.480832 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c94acd9f-3220-4ccf-8e17-10fb7174c4a9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:59.481286 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c94acd9f-3220-4ccf-8e17-10fb7174c4a9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:59.631285 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c94acd9f-3220-4ccf-8e17-10fb7174c4a9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:23:59.639953 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c94acd9f-3220-4ccf-8e17-10fb7174c4a9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.175594 Jun 16 17:23:59.640889 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 89/181] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:59 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:23:59.788291 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0ead1687-0804-415f-89ae-86368d0e1efd tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:23:59.788895 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0ead1687-0804-415f-89ae-86368d0e1efd tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:23:59.797430 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0ead1687-0804-415f-89ae-86368d0e1efd tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:59.797910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0ead1687-0804-415f-89ae-86368d0e1efd tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:59.798650 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0ead1687-0804-415f-89ae-86368d0e1efd tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:23:59.799053 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0ead1687-0804-415f-89ae-86368d0e1efd tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:23:59.826999 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=100 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:24:00.102699 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0ead1687-0804-415f-89ae-86368d0e1efd tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:00.112217 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0ead1687-0804-415f-89ae-86368d0e1efd tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1554 microversion: 2.1 time: 0.327796 Jun 16 17:24:00.112804 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 93/182] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:23:59 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1554 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:00.418645 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-fb3706c8-92df-49d2-8f37-671369e7e765 req-4fb011b4-4948-47ce-9171-9a2007f03518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b787b3-74c7-4e30-9f10-acea71d19c0c", "name": "network-vif-deleted", "tag": "793bfabc-d2dc-472c-95a2-270f46bad4dc"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:00.429146 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-fb3706c8-92df-49d2-8f37-671369e7e765 req-4fb011b4-4948-47ce-9171-9a2007f03518 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:00.429989 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-fb3706c8-92df-49d2-8f37-671369e7e765 req-4fb011b4-4948-47ce-9171-9a2007f03518 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:00.443016 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-fb3706c8-92df-49d2-8f37-671369e7e765 req-4fb011b4-4948-47ce-9171-9a2007f03518 service nova] Creating event network-vif-deleted:793bfabc-d2dc-472c-95a2-270f46bad4dc for instance 57b787b3-74c7-4e30-9f10-acea71d19c0c on hv-cinder-83735 Jun 16 17:24:00.449019 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-fb3706c8-92df-49d2-8f37-671369e7e765 req-4fb011b4-4948-47ce-9171-9a2007f03518 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034233 Jun 16 17:24:00.449719 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 90/183] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:24:00.660555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0fa807d3-ba32-4862-9785-d9d964747f61 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:00.661315 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0fa807d3-ba32-4862-9785-d9d964747f61 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:00.668595 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0fa807d3-ba32-4862-9785-d9d964747f61 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:00.669139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0fa807d3-ba32-4862-9785-d9d964747f61 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:00.669989 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0fa807d3-ba32-4862-9785-d9d964747f61 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:00.670479 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0fa807d3-ba32-4862-9785-d9d964747f61 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:00.839766 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0fa807d3-ba32-4862-9785-d9d964747f61 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:00.849391 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0fa807d3-ba32-4862-9785-d9d964747f61 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.194974 Jun 16 17:24:00.850348 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 94/184] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:00 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:01.130930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d1fe9b81-5beb-481d-8722-91ceff3ea0cb tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:01.131681 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-d1fe9b81-5beb-481d-8722-91ceff3ea0cb tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:01.139408 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d1fe9b81-5beb-481d-8722-91ceff3ea0cb tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:01.139869 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d1fe9b81-5beb-481d-8722-91ceff3ea0cb tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:01.140617 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d1fe9b81-5beb-481d-8722-91ceff3ea0cb tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:01.141036 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d1fe9b81-5beb-481d-8722-91ceff3ea0cb tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:01.213613 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d1fe9b81-5beb-481d-8722-91ceff3ea0cb tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a132fd2fe24343239eafa8c46abaa2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859da351f9cc437ebe79e5bdb87a177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:01.222074 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-d1fe9b81-5beb-481d-8722-91ceff3ea0cb tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 200 len: 1345 microversion: 2.1 time: 0.095796 Jun 16 17:24:01.222746 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 91/185] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:01 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 1345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:01.870365 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c26d21ba-4ac5-44af-ad3b-31646716552b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:01.870950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c26d21ba-4ac5-44af-ad3b-31646716552b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:01.877166 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c26d21ba-4ac5-44af-ad3b-31646716552b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:01.877864 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c26d21ba-4ac5-44af-ad3b-31646716552b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:01.878755 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c26d21ba-4ac5-44af-ad3b-31646716552b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:01.879104 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c26d21ba-4ac5-44af-ad3b-31646716552b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:02.034175 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c26d21ba-4ac5-44af-ad3b-31646716552b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:02.044074 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c26d21ba-4ac5-44af-ad3b-31646716552b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.177679 Jun 16 17:24:02.044650 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 95/186] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:01 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:02.243075 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-df4a4480-cc7b-4e3c-a0a5-5150be162464 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:02.243811 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-df4a4480-cc7b-4e3c-a0a5-5150be162464 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:02.250993 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-df4a4480-cc7b-4e3c-a0a5-5150be162464 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:02.251432 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-df4a4480-cc7b-4e3c-a0a5-5150be162464 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:02.252197 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-df4a4480-cc7b-4e3c-a0a5-5150be162464 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:02.252622 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-df4a4480-cc7b-4e3c-a0a5-5150be162464 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:02.268935 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-df4a4480-cc7b-4e3c-a0a5-5150be162464 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] HTTP exception thrown: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-df4a4480-cc7b-4e3c-a0a5-5150be162464 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Request method failure captured: Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c HTTP/1.1 Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2baJKBCL40xYnijuSuDVYw_WDmhSgUCSp3MFgL9zXrWIQ9W5uHMUSZDlUVC5Y0r3Hh034Zv5aQzV2kMiuv3-eoE2uxINKNMVdMX5lAAXPuaiNXsCxc5tE638_GnKTZgLVeB8a4dnXds6BqEqZxvGR4PIS_7ZYBGockjfyJsASDwXoM Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: 859da351f9cc437ebe79e5bdb87a177d Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-DeleteServersTestJSON-168559711 Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:24:02.275652 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:24:02.277091 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/859da351f9cc437ebe79e5bdb87a177d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/859da351f9cc437ebe79e5bdb87a177d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_859da351f9cc437ebe79e5bdb87a177d", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/859da351f9cc437ebe79e5bdb87a177d"}]}] Jun 16 17:24:02.277091 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-DeleteServersTestJSON-168559711 Jun 16 17:24:02.277091 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: 859da351f9cc437ebe79e5bdb87a177d Jun 16 17:24:02.277091 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-DeleteServersTestJSON-168559711 Jun 16 17:24:02.277091 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-DeleteServersTestJSON-168559711-project Jun 16 17:24:02.277091 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:24:02.277091 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:24:02.277091 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: a132fd2fe24343239eafa8c46abaa2ed Jun 16 17:24:02.277091 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-DeleteServersTestJSON-168559711-project Jun 16 17:24:02.277091 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:24:02.277091 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:02.277091 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': '57b787b3-74c7-4e30-9f10-acea71d19c0c'} Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:24:02.277973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:02.279149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:02.280133 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-df4a4480-cc7b-4e3c-a0a5-5150be162464 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Returning 404 to user: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:24:02.280133 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-df4a4480-cc7b-4e3c-a0a5-5150be162464 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 404 len: 111 microversion: 2.1 time: 0.038125 Jun 16 17:24:02.280133 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 92/187] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:02 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:24:02.386832 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7cef5134-6051-4a4f-a999-8e87bcf37472 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:02.387724 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7cef5134-6051-4a4f-a999-8e87bcf37472 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:02.393865 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7cef5134-6051-4a4f-a999-8e87bcf37472 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:02.394325 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7cef5134-6051-4a4f-a999-8e87bcf37472 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:02.395076 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7cef5134-6051-4a4f-a999-8e87bcf37472 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:02.395503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7cef5134-6051-4a4f-a999-8e87bcf37472 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:02.409450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-7cef5134-6051-4a4f-a999-8e87bcf37472 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] HTTP exception thrown: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7cef5134-6051-4a4f-a999-8e87bcf37472 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Request method failure captured: Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c/os-volume_attachments HTTP/1.1 Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2baJKBCL40xYnijuSuDVYw_WDmhSgUCSp3MFgL9zXrWIQ9W5uHMUSZDlUVC5Y0r3Hh034Zv5aQzV2kMiuv3-eoE2uxINKNMVdMX5lAAXPuaiNXsCxc5tE638_GnKTZgLVeB8a4dnXds6BqEqZxvGR4PIS_7ZYBGockjfyJsASDwXoM Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 859da351f9cc437ebe79e5bdb87a177d Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-DeleteServersTestJSON-168559711 Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:24:02.414555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:24:02.415832 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/859da351f9cc437ebe79e5bdb87a177d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/859da351f9cc437ebe79e5bdb87a177d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_859da351f9cc437ebe79e5bdb87a177d", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/859da351f9cc437ebe79e5bdb87a177d"}]}] Jun 16 17:24:02.415832 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-DeleteServersTestJSON-168559711 Jun 16 17:24:02.415832 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 859da351f9cc437ebe79e5bdb87a177d Jun 16 17:24:02.415832 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-DeleteServersTestJSON-168559711 Jun 16 17:24:02.415832 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-DeleteServersTestJSON-168559711-project Jun 16 17:24:02.415832 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:24:02.415832 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:24:02.415832 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: a132fd2fe24343239eafa8c46abaa2ed Jun 16 17:24:02.415832 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-DeleteServersTestJSON-168559711-project Jun 16 17:24:02.415832 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:24:02.415832 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:02.415832 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'server_id': '57b787b3-74c7-4e30-9f10-acea71d19c0c'} Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:24:02.416490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:02.417837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:02.419123 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7cef5134-6051-4a4f-a999-8e87bcf37472 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Returning 404 to user: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:24:02.419123 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7cef5134-6051-4a4f-a999-8e87bcf37472 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033442 Jun 16 17:24:02.419123 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 96/188] 10.222.0.66 () {58 vars in 1301 bytes} [Thu Jun 16 17:24:02 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:24:03.061386 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-069b336b-3308-4980-9376-b93066e01272 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:03.062002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-069b336b-3308-4980-9376-b93066e01272 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:03.069043 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-069b336b-3308-4980-9376-b93066e01272 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:03.069523 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-069b336b-3308-4980-9376-b93066e01272 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:03.070305 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-069b336b-3308-4980-9376-b93066e01272 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:03.071038 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-069b336b-3308-4980-9376-b93066e01272 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:03.223576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-069b336b-3308-4980-9376-b93066e01272 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:03.228851 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-069b336b-3308-4980-9376-b93066e01272 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.171448 Jun 16 17:24:03.229447 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 93/189] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:03 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:03.636868 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8ad62f43-b32c-4c8f-ac68-e7105f236bb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:03.638048 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8ad62f43-b32c-4c8f-ac68-e7105f236bb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:03.645960 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ad62f43-b32c-4c8f-ac68-e7105f236bb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:03.646414 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ad62f43-b32c-4c8f-ac68-e7105f236bb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:03.647266 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ad62f43-b32c-4c8f-ac68-e7105f236bb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:03.647711 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ad62f43-b32c-4c8f-ac68-e7105f236bb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:03.667591 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-8ad62f43-b32c-4c8f-ac68-e7105f236bb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] HTTP exception thrown: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8ad62f43-b32c-4c8f-ac68-e7105f236bb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Request method failure captured: Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: DELETE /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c HTTP/1.1 Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2baJKBCL40xYnijuSuDVYw_WDmhSgUCSp3MFgL9zXrWIQ9W5uHMUSZDlUVC5Y0r3Hh034Zv5aQzV2kMiuv3-eoE2uxINKNMVdMX5lAAXPuaiNXsCxc5tE638_GnKTZgLVeB8a4dnXds6BqEqZxvGR4PIS_7ZYBGockjfyJsASDwXoM Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 859da351f9cc437ebe79e5bdb87a177d Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-DeleteServersTestJSON-168559711 Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:24:03.669893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:24:03.671161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/859da351f9cc437ebe79e5bdb87a177d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/859da351f9cc437ebe79e5bdb87a177d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_859da351f9cc437ebe79e5bdb87a177d", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/859da351f9cc437ebe79e5bdb87a177d"}]}] Jun 16 17:24:03.671161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-DeleteServersTestJSON-168559711 Jun 16 17:24:03.671161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 859da351f9cc437ebe79e5bdb87a177d Jun 16 17:24:03.671161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-DeleteServersTestJSON-168559711 Jun 16 17:24:03.671161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-DeleteServersTestJSON-168559711-project Jun 16 17:24:03.671161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:24:03.671161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:24:03.671161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: a132fd2fe24343239eafa8c46abaa2ed Jun 16 17:24:03.671161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-DeleteServersTestJSON-168559711-project Jun 16 17:24:03.671161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:24:03.671161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:03.671161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': '57b787b3-74c7-4e30-9f10-acea71d19c0c'} Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:24:03.671826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:03.672889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:03.674058 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8ad62f43-b32c-4c8f-ac68-e7105f236bb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Returning 404 to user: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:24:03.674058 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8ad62f43-b32c-4c8f-ac68-e7105f236bb7 tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "DELETE /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 404 len: 111 microversion: 2.1 time: 0.041488 Jun 16 17:24:03.674058 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 97/190] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:24:03 2022] DELETE /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:24:03.680839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c5e52a8c-d1ce-4467-b3c4-3ee3877066ee tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:03.681575 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c5e52a8c-d1ce-4467-b3c4-3ee3877066ee tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] [instance: 57b787b3-74c7-4e30-9f10-acea71d19c0c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:03.695471 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c5e52a8c-d1ce-4467-b3c4-3ee3877066ee tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:03.695723 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c5e52a8c-d1ce-4467-b3c4-3ee3877066ee tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:03.696519 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c5e52a8c-d1ce-4467-b3c4-3ee3877066ee tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:03.696958 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c5e52a8c-d1ce-4467-b3c4-3ee3877066ee tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:03.717470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-c5e52a8c-d1ce-4467-b3c4-3ee3877066ee tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] HTTP exception thrown: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c5e52a8c-d1ce-4467-b3c4-3ee3877066ee tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Request method failure captured: Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c HTTP/1.1 Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2baJKBCL40xYnijuSuDVYw_WDmhSgUCSp3MFgL9zXrWIQ9W5uHMUSZDlUVC5Y0r3Hh034Zv5aQzV2kMiuv3-eoE2uxINKNMVdMX5lAAXPuaiNXsCxc5tE638_GnKTZgLVeB8a4dnXds6BqEqZxvGR4PIS_7ZYBGockjfyJsASDwXoM Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: 859da351f9cc437ebe79e5bdb87a177d Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-DeleteServersTestJSON-168559711 Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:24:03.719453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:24:03.720995 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/859da351f9cc437ebe79e5bdb87a177d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/859da351f9cc437ebe79e5bdb87a177d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_859da351f9cc437ebe79e5bdb87a177d", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/859da351f9cc437ebe79e5bdb87a177d"}]}] Jun 16 17:24:03.720995 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-DeleteServersTestJSON-168559711 Jun 16 17:24:03.720995 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: 859da351f9cc437ebe79e5bdb87a177d Jun 16 17:24:03.720995 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-DeleteServersTestJSON-168559711 Jun 16 17:24:03.720995 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-DeleteServersTestJSON-168559711-project Jun 16 17:24:03.720995 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:24:03.720995 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:24:03.720995 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: a132fd2fe24343239eafa8c46abaa2ed Jun 16 17:24:03.720995 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-DeleteServersTestJSON-168559711-project Jun 16 17:24:03.720995 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:24:03.720995 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:03.720995 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': '57b787b3-74c7-4e30-9f10-acea71d19c0c'} Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:24:03.721872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. Jun 16 17:24:03.723166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:03.725812 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c5e52a8c-d1ce-4467-b3c4-3ee3877066ee tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] Returning 404 to user: Instance 57b787b3-74c7-4e30-9f10-acea71d19c0c could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:24:03.726890 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c5e52a8c-d1ce-4467-b3c4-3ee3877066ee tempest-DeleteServersTestJSON-168559711 tempest-DeleteServersTestJSON-168559711-project] 10.222.0.66 "GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c" status: 404 len: 111 microversion: 2.1 time: 0.050733 Jun 16 17:24:03.727591 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 94/191] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:03 2022] GET /compute/v2.1/servers/57b787b3-74c7-4e30-9f10-acea71d19c0c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:24:04.247996 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f19d3bc4-8519-4e6d-a808-59a08068b5b6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:04.248896 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f19d3bc4-8519-4e6d-a808-59a08068b5b6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:04.255718 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f19d3bc4-8519-4e6d-a808-59a08068b5b6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:04.256371 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f19d3bc4-8519-4e6d-a808-59a08068b5b6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:04.257361 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f19d3bc4-8519-4e6d-a808-59a08068b5b6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:04.257974 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f19d3bc4-8519-4e6d-a808-59a08068b5b6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:04.411564 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f19d3bc4-8519-4e6d-a808-59a08068b5b6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:04.422894 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f19d3bc4-8519-4e6d-a808-59a08068b5b6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.179919 Jun 16 17:24:04.423507 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 98/192] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:04 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:05.444335 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-70c9a893-7b40-40d3-8ef5-bf842d96de86 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:05.448077 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-70c9a893-7b40-40d3-8ef5-bf842d96de86 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:05.457841 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-70c9a893-7b40-40d3-8ef5-bf842d96de86 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:05.458842 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-70c9a893-7b40-40d3-8ef5-bf842d96de86 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:05.460588 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-70c9a893-7b40-40d3-8ef5-bf842d96de86 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:05.461518 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-70c9a893-7b40-40d3-8ef5-bf842d96de86 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:05.760994 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-70c9a893-7b40-40d3-8ef5-bf842d96de86 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:05.777046 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-70c9a893-7b40-40d3-8ef5-bf842d96de86 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.340210 Jun 16 17:24:05.778533 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 95/193] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:05 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:06.808199 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-39316cda-3eda-4bcd-b7aa-8757d4fb4845 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:06.809907 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-39316cda-3eda-4bcd-b7aa-8757d4fb4845 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:06.814130 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=53 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:24:06.825374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-39316cda-3eda-4bcd-b7aa-8757d4fb4845 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:06.826107 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-39316cda-3eda-4bcd-b7aa-8757d4fb4845 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:06.827025 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-39316cda-3eda-4bcd-b7aa-8757d4fb4845 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:06.827582 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-39316cda-3eda-4bcd-b7aa-8757d4fb4845 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:07.206339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-39316cda-3eda-4bcd-b7aa-8757d4fb4845 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:07.214839 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-39316cda-3eda-4bcd-b7aa-8757d4fb4845 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.415274 Jun 16 17:24:07.229404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 99/194] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:06 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:08.238768 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8d49b34c-b69b-42a9-841d-69c5829cba09 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:08.239366 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-8d49b34c-b69b-42a9-841d-69c5829cba09 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:08.246307 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8d49b34c-b69b-42a9-841d-69c5829cba09 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:08.246745 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8d49b34c-b69b-42a9-841d-69c5829cba09 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:08.247585 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8d49b34c-b69b-42a9-841d-69c5829cba09 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:08.248008 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8d49b34c-b69b-42a9-841d-69c5829cba09 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:08.386560 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8d49b34c-b69b-42a9-841d-69c5829cba09 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:08.394245 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8d49b34c-b69b-42a9-841d-69c5829cba09 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.161042 Jun 16 17:24:08.394834 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 96/195] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:08 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:09.411408 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-eb075ad1-7a64-40a7-9498-8d7e8a115217 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:09.412293 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-eb075ad1-7a64-40a7-9498-8d7e8a115217 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:09.420476 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-eb075ad1-7a64-40a7-9498-8d7e8a115217 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:09.420980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-eb075ad1-7a64-40a7-9498-8d7e8a115217 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:09.421756 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-eb075ad1-7a64-40a7-9498-8d7e8a115217 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:09.422410 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-eb075ad1-7a64-40a7-9498-8d7e8a115217 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:09.572413 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-eb075ad1-7a64-40a7-9498-8d7e8a115217 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:09.580028 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-eb075ad1-7a64-40a7-9498-8d7e8a115217 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.173055 Jun 16 17:24:09.580671 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 100/196] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:09 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:10.021384 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-065d6bd3-018a-487a-9c27-a32caa829a5e tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Action: 'create', calling method: .version_select at 0x7f66b18719d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1013352190"}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:10.356762 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-065d6bd3-018a-487a-9c27-a32caa829a5e tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.481053 Jun 16 17:24:10.357719 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 97/197] 10.222.0.66 () {60 vars in 1154 bytes} [Thu Jun 16 17:24:09 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 483 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 17:24:10.369529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c20a46fe-9c89-4799-b08a-86ca5dcf3bee tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Calling method '.version_select at 0x7f66b190c3a0>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:10.442314 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c20a46fe-9c89-4799-b08a-86ca5dcf3bee tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/cb4e8609-8cc4-42c7-a6a9-b4fc511e221b" status: 200 len: 345 microversion: 2.1 time: 0.077180 Jun 16 17:24:10.442988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 101/198] 10.222.0.66 () {58 vars in 1244 bytes} [Thu Jun 16 17:24:10 2022] GET /compute/v2.1/os-volumes/cb4e8609-8cc4-42c7-a6a9-b4fc511e221b => generated 345 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:24:10.597838 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7bb1912c-dbfd-4f7e-a1a3-14254d18d344 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:10.598550 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-7bb1912c-dbfd-4f7e-a1a3-14254d18d344 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:10.607275 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7bb1912c-dbfd-4f7e-a1a3-14254d18d344 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:10.607988 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7bb1912c-dbfd-4f7e-a1a3-14254d18d344 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:10.609029 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7bb1912c-dbfd-4f7e-a1a3-14254d18d344 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:10.609332 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7bb1912c-dbfd-4f7e-a1a3-14254d18d344 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:10.796959 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7bb1912c-dbfd-4f7e-a1a3-14254d18d344 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:10.813649 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7bb1912c-dbfd-4f7e-a1a3-14254d18d344 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.219302 Jun 16 17:24:10.818245 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 98/199] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:10 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:11.456360 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5af4db6a-62a6-493e-ac42-fc16b8854809 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Calling method '.version_select at 0x7f66b1869310>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:11.528732 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-5af4db6a-62a6-493e-ac42-fc16b8854809 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/cb4e8609-8cc4-42c7-a6a9-b4fc511e221b" status: 200 len: 346 microversion: 2.1 time: 0.076378 Jun 16 17:24:11.529333 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 102/200] 10.222.0.66 () {58 vars in 1244 bytes} [Thu Jun 16 17:24:11 2022] GET /compute/v2.1/os-volumes/cb4e8609-8cc4-42c7-a6a9-b4fc511e221b => generated 346 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:24:11.546336 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-6d5d34a4-28c8-4100-8fd8-530be6ff2e73 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Action: 'create', calling method: .version_select at 0x7f66b1a0f940>, body: {"snapshot": {"volume_id": "cb4e8609-8cc4-42c7-a6a9-b4fc511e221b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1958333723"}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:11.741710 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-6d5d34a4-28c8-4100-8fd8-530be6ff2e73 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.199482 Jun 16 17:24:11.749208 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 99/201] 10.222.0.66 () {60 vars in 1161 bytes} [Thu Jun 16 17:24:11 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:24:11.754415 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-227389b7-1e0c-4a7d-9978-a44afd325f94 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Calling method '.version_select at 0x7f66b18699d0>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:11.811140 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-227389b7-1e0c-4a7d-9978-a44afd325f94 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/4ec4750d-ff46-4c11-88ce-059e9fb6cbcf" status: 200 len: 287 microversion: 2.1 time: 0.058939 Jun 16 17:24:11.813357 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 103/202] 10.222.0.66 () {58 vars in 1250 bytes} [Thu Jun 16 17:24:11 2022] GET /compute/v2.1/os-snapshots/4ec4750d-ff46-4c11-88ce-059e9fb6cbcf => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:24:11.824294 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-40dfd66a-ef90-4b67-a927-032a00753344 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Calling method '.version_select at 0x7f66b18714c0>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:11.839824 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-aaedf2b7-3861-4bc5-a2cf-7ca4a5cf672e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:11.840579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-aaedf2b7-3861-4bc5-a2cf-7ca4a5cf672e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:11.853257 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-aaedf2b7-3861-4bc5-a2cf-7ca4a5cf672e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:11.853800 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-aaedf2b7-3861-4bc5-a2cf-7ca4a5cf672e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:11.854728 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-aaedf2b7-3861-4bc5-a2cf-7ca4a5cf672e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:11.855280 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-aaedf2b7-3861-4bc5-a2cf-7ca4a5cf672e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:11.910030 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-40dfd66a-ef90-4b67-a927-032a00753344 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.089980 Jun 16 17:24:11.918203 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 100/203] 10.222.0.66 () {58 vars in 1139 bytes} [Thu Jun 16 17:24:11 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:24:11.924432 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-38cfa964-4328-4d01-802d-b77f5d6e0c3f tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Calling method '.version_select at 0x7f66b1871b80>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:12.025782 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-38cfa964-4328-4d01-802d-b77f5d6e0c3f tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/4ec4750d-ff46-4c11-88ce-059e9fb6cbcf" status: 200 len: 287 microversion: 2.1 time: 0.105612 Jun 16 17:24:12.026353 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 101/204] 10.222.0.66 () {58 vars in 1250 bytes} [Thu Jun 16 17:24:11 2022] GET /compute/v2.1/os-snapshots/4ec4750d-ff46-4c11-88ce-059e9fb6cbcf => generated 287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:24:12.071413 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-aaedf2b7-3861-4bc5-a2cf-7ca4a5cf672e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:12.080815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-aaedf2b7-3861-4bc5-a2cf-7ca4a5cf672e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.246332 Jun 16 17:24:12.081826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 104/205] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:11 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:13.038208 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-50408b17-1373-4d7a-828d-e7be67179805 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Calling method '.version_select at 0x7f66b1a59b80>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:13.068466 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-50408b17-1373-4d7a-828d-e7be67179805 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/4ec4750d-ff46-4c11-88ce-059e9fb6cbcf" status: 200 len: 287 microversion: 2.1 time: 0.034590 Jun 16 17:24:13.069021 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 102/206] 10.222.0.66 () {58 vars in 1250 bytes} [Thu Jun 16 17:24:13 2022] GET /compute/v2.1/os-snapshots/4ec4750d-ff46-4c11-88ce-059e9fb6cbcf => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:24:13.098188 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-15ee3431-3d9e-46c8-91db-40a61f2e2b43 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:13.098978 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-15ee3431-3d9e-46c8-91db-40a61f2e2b43 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:13.106768 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-15ee3431-3d9e-46c8-91db-40a61f2e2b43 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:13.107592 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-15ee3431-3d9e-46c8-91db-40a61f2e2b43 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:13.110026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-15ee3431-3d9e-46c8-91db-40a61f2e2b43 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:13.110542 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-15ee3431-3d9e-46c8-91db-40a61f2e2b43 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:13.473995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-15ee3431-3d9e-46c8-91db-40a61f2e2b43 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:13.482272 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-15ee3431-3d9e-46c8-91db-40a61f2e2b43 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.387815 Jun 16 17:24:13.482841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 105/207] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:13 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:14.080629 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8157555d-6d40-4bf3-b829-9bfece82eb44 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Calling method '.version_select at 0x7f66b197b940>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:14.112662 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8157555d-6d40-4bf3-b829-9bfece82eb44 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/4ec4750d-ff46-4c11-88ce-059e9fb6cbcf" status: 200 len: 287 microversion: 2.1 time: 0.036476 Jun 16 17:24:14.113344 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 103/208] 10.222.0.66 () {58 vars in 1250 bytes} [Thu Jun 16 17:24:14 2022] GET /compute/v2.1/os-snapshots/4ec4750d-ff46-4c11-88ce-059e9fb6cbcf => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:24:14.499513 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-74a685d5-f7fa-4fca-bef6-a89645727ab3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:14.500115 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-74a685d5-f7fa-4fca-bef6-a89645727ab3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:14.508279 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-74a685d5-f7fa-4fca-bef6-a89645727ab3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:14.509015 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-74a685d5-f7fa-4fca-bef6-a89645727ab3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:14.509829 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-74a685d5-f7fa-4fca-bef6-a89645727ab3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:14.510255 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-74a685d5-f7fa-4fca-bef6-a89645727ab3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:14.695986 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-74a685d5-f7fa-4fca-bef6-a89645727ab3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:14.704912 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-74a685d5-f7fa-4fca-bef6-a89645727ab3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.209194 Jun 16 17:24:14.705688 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 106/209] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:14 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:15.130019 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-da66c507-e87a-44ab-a50b-5526b03b591a tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Calling method '.version_select at 0x7f66b18cdd30>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:15.180864 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-da66c507-e87a-44ab-a50b-5526b03b591a tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/4ec4750d-ff46-4c11-88ce-059e9fb6cbcf" status: 200 len: 288 microversion: 2.1 time: 0.057573 Jun 16 17:24:15.181702 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 104/210] 10.222.0.66 () {58 vars in 1250 bytes} [Thu Jun 16 17:24:15 2022] GET /compute/v2.1/os-snapshots/4ec4750d-ff46-4c11-88ce-059e9fb6cbcf => generated 288 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:24:15.195033 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-bdd6accf-2408-46b1-8818-70250e91f83a tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Calling method '.version_select at 0x7f66b188d9d0>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:15.315238 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-bdd6accf-2408-46b1-8818-70250e91f83a tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/4ec4750d-ff46-4c11-88ce-059e9fb6cbcf" status: 202 len: 0 microversion: 2.1 time: 0.124346 Jun 16 17:24:15.321410 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 107/211] 10.222.0.66 () {58 vars in 1253 bytes} [Thu Jun 16 17:24:15 2022] DELETE /compute/v2.1/os-snapshots/4ec4750d-ff46-4c11-88ce-059e9fb6cbcf => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:24:15.331233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-0140c58d-f937-413c-b5b8-8edcc7d6f7ce tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Calling method '.version_select at 0x7f66b1a0f0d0>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:15.380079 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-0140c58d-f937-413c-b5b8-8edcc7d6f7ce tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/4ec4750d-ff46-4c11-88ce-059e9fb6cbcf" status: 200 len: 287 microversion: 2.1 time: 0.056597 Jun 16 17:24:15.380675 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 105/212] 10.222.0.66 () {58 vars in 1250 bytes} [Thu Jun 16 17:24:15 2022] GET /compute/v2.1/os-snapshots/4ec4750d-ff46-4c11-88ce-059e9fb6cbcf => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:24:15.728185 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-95cc7156-31cc-4158-8481-9481cc7e8586 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:15.728752 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-95cc7156-31cc-4158-8481-9481cc7e8586 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:15.735542 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-95cc7156-31cc-4158-8481-9481cc7e8586 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:15.735982 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-95cc7156-31cc-4158-8481-9481cc7e8586 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:15.736723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-95cc7156-31cc-4158-8481-9481cc7e8586 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:15.737143 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-95cc7156-31cc-4158-8481-9481cc7e8586 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:16.038685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-95cc7156-31cc-4158-8481-9481cc7e8586 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:16.046374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-95cc7156-31cc-4158-8481-9481cc7e8586 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1521 microversion: 2.1 time: 0.322163 Jun 16 17:24:16.046981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 108/213] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:15 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:16.392562 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f04d4c4a-72e0-4b06-83c4-dd2503283867 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Calling method '.version_select at 0x7f66b1b9f280>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:16.420629 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-f04d4c4a-72e0-4b06-83c4-dd2503283867 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] HTTP exception thrown: Snapshot 4ec4750d-ff46-4c11-88ce-059e9fb6cbcf could not be found. Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f04d4c4a-72e0-4b06-83c4-dd2503283867 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Request method failure captured: Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/os-snapshots/4ec4750d-ff46-4c11-88ce-059e9fb6cbcf HTTP/1.1 Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2c5h5HGgh0VMB_OAOtOGzvDBnABuE55LGye8qR-TzgqU1aJQ6XPRVaZqvn4HHR8aqZdoCfwtBDGJtG7ezkLP5y2FBhJyVTLRqSsPp0HFf18ZSOqyy8fz5sm9cM9GZ0XYp3ddyMXSyBa-JrRyGY8r24waWaWNQkL1C8pw6Vtqij1zYs Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: 489df5c12d274a23be1c0bf87dc09dc7 Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1919075906 Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:24:16.424587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:24:16.426184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/489df5c12d274a23be1c0bf87dc09dc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/489df5c12d274a23be1c0bf87dc09dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_489df5c12d274a23be1c0bf87dc09dc7", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/489df5c12d274a23be1c0bf87dc09dc7"}]}] Jun 16 17:24:16.426184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1919075906 Jun 16 17:24:16.426184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: 489df5c12d274a23be1c0bf87dc09dc7 Jun 16 17:24:16.426184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1919075906 Jun 16 17:24:16.426184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-VolumesSnapshotsTestJSON-1919075906-project Jun 16 17:24:16.426184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:24:16.426184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:24:16.426184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: b8c37bfdb2384b838f6e5a0c7b0c1b4d Jun 16 17:24:16.426184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1919075906-project Jun 16 17:24:16.426184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: Jun 16 17:24:16.426184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Snapshot 4ec4750d-ff46-4c11-88ce-059e9fb6cbcf could not be found. Jun 16 17:24:16.426184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': '4ec4750d-ff46-4c11-88ce-059e9fb6cbcf'} Jun 16 17:24:16.426184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4ec4750d-ff46-4c11-88ce-059e9fb6cbcf could not be found. (HTTP 404) (Request-ID: req-c5f56c72-1346-45d7-be70-8493cb17ff85) Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:16.427095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:24:16.428127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4ec4750d-ff46-4c11-88ce-059e9fb6cbcf could not be found. Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 17:24:16.429348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:24:16.430687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4ec4750d-ff46-4c11-88ce-059e9fb6cbcf could not be found. Jun 16 17:24:16.430687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:16.430687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:16.430687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:16.430687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:16.430687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:16.430687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:16.430687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:24:16.430687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:24:16.430687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4ec4750d-ff46-4c11-88ce-059e9fb6cbcf could not be found. Jun 16 17:24:16.430687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:16.432274 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f04d4c4a-72e0-4b06-83c4-dd2503283867 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Returning 404 to user: Snapshot 4ec4750d-ff46-4c11-88ce-059e9fb6cbcf could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:24:16.433101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f04d4c4a-72e0-4b06-83c4-dd2503283867 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/4ec4750d-ff46-4c11-88ce-059e9fb6cbcf" status: 404 len: 111 microversion: 2.1 time: 0.045026 Jun 16 17:24:16.433697 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 106/214] 10.222.0.66 () {58 vars in 1250 bytes} [Thu Jun 16 17:24:16 2022] GET /compute/v2.1/os-snapshots/4ec4750d-ff46-4c11-88ce-059e9fb6cbcf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:24:16.442916 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8d88c2fb-93d1-4c8f-9dc9-252b2b5e42cd tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Calling method '.version_select at 0x7f66b19b4040>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:16.564032 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8d88c2fb-93d1-4c8f-9dc9-252b2b5e42cd tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/cb4e8609-8cc4-42c7-a6a9-b4fc511e221b" status: 202 len: 0 microversion: 2.1 time: 0.125273 Jun 16 17:24:16.564951 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 109/215] 10.222.0.66 () {58 vars in 1247 bytes} [Thu Jun 16 17:24:16 2022] DELETE /compute/v2.1/os-volumes/cb4e8609-8cc4-42c7-a6a9-b4fc511e221b => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:24:16.583016 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-41fb550b-4987-4e61-ae19-e0384db14cb0 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Calling method '.version_select at 0x7f66b182d0d0>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:16.673388 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-41fb550b-4987-4e61-ae19-e0384db14cb0 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/cb4e8609-8cc4-42c7-a6a9-b4fc511e221b" status: 200 len: 345 microversion: 2.1 time: 0.103888 Jun 16 17:24:16.678419 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 107/216] 10.222.0.66 () {58 vars in 1244 bytes} [Thu Jun 16 17:24:16 2022] GET /compute/v2.1/os-volumes/cb4e8609-8cc4-42c7-a6a9-b4fc511e221b => generated 345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:24:17.064416 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a90cfa3e-f598-4d15-b979-48fbabb7203e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:17.065033 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a90cfa3e-f598-4d15-b979-48fbabb7203e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:17.071703 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a90cfa3e-f598-4d15-b979-48fbabb7203e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:17.072145 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a90cfa3e-f598-4d15-b979-48fbabb7203e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:17.072906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a90cfa3e-f598-4d15-b979-48fbabb7203e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:17.073367 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a90cfa3e-f598-4d15-b979-48fbabb7203e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:17.236685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a90cfa3e-f598-4d15-b979-48fbabb7203e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:17.245623 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a90cfa3e-f598-4d15-b979-48fbabb7203e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1501 microversion: 2.1 time: 0.185303 Jun 16 17:24:17.246183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 110/217] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:17 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1501 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:17.264189 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-60a7e2df-8941-4ec7-8d5e-5aeb2ae471d1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:17.264785 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-60a7e2df-8941-4ec7-8d5e-5aeb2ae471d1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:17.272043 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-60a7e2df-8941-4ec7-8d5e-5aeb2ae471d1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:17.272345 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-60a7e2df-8941-4ec7-8d5e-5aeb2ae471d1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:17.273100 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-60a7e2df-8941-4ec7-8d5e-5aeb2ae471d1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:17.273742 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-60a7e2df-8941-4ec7-8d5e-5aeb2ae471d1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:17.433213 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-60a7e2df-8941-4ec7-8d5e-5aeb2ae471d1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:17.445772 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-60a7e2df-8941-4ec7-8d5e-5aeb2ae471d1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1515 microversion: 2.1 time: 0.186275 Jun 16 17:24:17.446740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 108/218] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:17 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:17.688909 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-72d968cf-ddf4-4394-b9a4-e4025c43a3ff tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Calling method '.version_select at 0x7f66b1b248b0>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:17.729123 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-72d968cf-ddf4-4394-b9a4-e4025c43a3ff tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] HTTP exception thrown: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-72d968cf-ddf4-4394-b9a4-e4025c43a3ff tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Request method failure captured: Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/os-volumes/cb4e8609-8cc4-42c7-a6a9-b4fc511e221b HTTP/1.1 Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2c5h5HGgh0VMB_OAOtOGzvDBnABuE55LGye8qR-TzgqU1aJQ6XPRVaZqvn4HHR8aqZdoCfwtBDGJtG7ezkLP5y2FBhJyVTLRqSsPp0HFf18ZSOqyy8fz5sm9cM9GZ0XYp3ddyMXSyBa-JrRyGY8r24waWaWNQkL1C8pw6Vtqij1zYs Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 489df5c12d274a23be1c0bf87dc09dc7 Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1919075906 Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:24:17.732726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:24:17.734294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/489df5c12d274a23be1c0bf87dc09dc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/489df5c12d274a23be1c0bf87dc09dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_489df5c12d274a23be1c0bf87dc09dc7", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/489df5c12d274a23be1c0bf87dc09dc7"}]}] Jun 16 17:24:17.734294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1919075906 Jun 16 17:24:17.734294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 489df5c12d274a23be1c0bf87dc09dc7 Jun 16 17:24:17.734294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1919075906 Jun 16 17:24:17.734294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-VolumesSnapshotsTestJSON-1919075906-project Jun 16 17:24:17.734294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:24:17.734294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:24:17.734294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: b8c37bfdb2384b838f6e5a0c7b0c1b4d Jun 16 17:24:17.734294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1919075906-project Jun 16 17:24:17.734294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: Jun 16 17:24:17.734294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. Jun 16 17:24:17.734294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': 'cb4e8609-8cc4-42c7-a6a9-b4fc511e221b'} Jun 16 17:24:17.734294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. (HTTP 404) (Request-ID: req-26883a29-e989-4fce-a984-cd157ca88a85) Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:17.735496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:24:17.736722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 17:24:17.737981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:24:17.739257 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. Jun 16 17:24:17.739257 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.739257 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:17.739257 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.739257 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:17.739257 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:17.739257 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:17.739257 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:24:17.739257 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:24:17.739257 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. Jun 16 17:24:17.739257 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.740937 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-72d968cf-ddf4-4394-b9a4-e4025c43a3ff tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Returning 404 to user: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:24:17.742188 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-72d968cf-ddf4-4394-b9a4-e4025c43a3ff tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/cb4e8609-8cc4-42c7-a6a9-b4fc511e221b" status: 404 len: 109 microversion: 2.1 time: 0.059125 Jun 16 17:24:17.743037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 111/219] 10.222.0.66 () {58 vars in 1244 bytes} [Thu Jun 16 17:24:17 2022] GET /compute/v2.1/os-volumes/cb4e8609-8cc4-42c7-a6a9-b4fc511e221b => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:24:17.756509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c707d150-38e6-4f19-8c20-3b605dc7b0dc tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Calling method '.version_select at 0x7f66b1832e50>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:17.804458 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-c707d150-38e6-4f19-8c20-3b605dc7b0dc tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] HTTP exception thrown: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c707d150-38e6-4f19-8c20-3b605dc7b0dc tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Request method failure captured: Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: DELETE /compute/v2.1/os-volumes/cb4e8609-8cc4-42c7-a6a9-b4fc511e221b HTTP/1.1 Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2c5h5HGgh0VMB_OAOtOGzvDBnABuE55LGye8qR-TzgqU1aJQ6XPRVaZqvn4HHR8aqZdoCfwtBDGJtG7ezkLP5y2FBhJyVTLRqSsPp0HFf18ZSOqyy8fz5sm9cM9GZ0XYp3ddyMXSyBa-JrRyGY8r24waWaWNQkL1C8pw6Vtqij1zYs Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: 489df5c12d274a23be1c0bf87dc09dc7 Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1919075906 Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:24:17.807067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:24:17.808576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/489df5c12d274a23be1c0bf87dc09dc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/489df5c12d274a23be1c0bf87dc09dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_489df5c12d274a23be1c0bf87dc09dc7", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/489df5c12d274a23be1c0bf87dc09dc7"}]}] Jun 16 17:24:17.808576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1919075906 Jun 16 17:24:17.808576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: 489df5c12d274a23be1c0bf87dc09dc7 Jun 16 17:24:17.808576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1919075906 Jun 16 17:24:17.808576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-VolumesSnapshotsTestJSON-1919075906-project Jun 16 17:24:17.808576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:24:17.808576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:24:17.808576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: b8c37bfdb2384b838f6e5a0c7b0c1b4d Jun 16 17:24:17.808576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1919075906-project Jun 16 17:24:17.808576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: Jun 16 17:24:17.808576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. Jun 16 17:24:17.808576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': 'cb4e8609-8cc4-42c7-a6a9-b4fc511e221b'} Jun 16 17:24:17.808576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. (HTTP 404) (Request-ID: req-1619256b-79ed-43a8-9275-8f7d43b14f70) Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:17.809592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:24:17.811102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 17:24:17.813539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:24:17.816909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. Jun 16 17:24:17.816909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.816909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:17.816909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.816909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:17.816909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:17.816909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:17.816909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:24:17.816909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:24:17.816909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. Jun 16 17:24:17.816909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.816909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c707d150-38e6-4f19-8c20-3b605dc7b0dc tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Returning 404 to user: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:24:17.816909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c707d150-38e6-4f19-8c20-3b605dc7b0dc tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/cb4e8609-8cc4-42c7-a6a9-b4fc511e221b" status: 404 len: 109 microversion: 2.1 time: 0.058677 Jun 16 17:24:17.816909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 109/220] 10.222.0.66 () {58 vars in 1247 bytes} [Thu Jun 16 17:24:17 2022] DELETE /compute/v2.1/os-volumes/cb4e8609-8cc4-42c7-a6a9-b4fc511e221b => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:24:17.821860 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-6d7e0648-8c4d-4e4f-baaf-3d0ea6208396 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Calling method '.version_select at 0x7f66b1b490d0>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:17.881595 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-6d7e0648-8c4d-4e4f-baaf-3d0ea6208396 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] HTTP exception thrown: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-6d7e0648-8c4d-4e4f-baaf-3d0ea6208396 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Request method failure captured: Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/os-volumes/cb4e8609-8cc4-42c7-a6a9-b4fc511e221b HTTP/1.1 Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2c5h5HGgh0VMB_OAOtOGzvDBnABuE55LGye8qR-TzgqU1aJQ6XPRVaZqvn4HHR8aqZdoCfwtBDGJtG7ezkLP5y2FBhJyVTLRqSsPp0HFf18ZSOqyy8fz5sm9cM9GZ0XYp3ddyMXSyBa-JrRyGY8r24waWaWNQkL1C8pw6Vtqij1zYs Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 489df5c12d274a23be1c0bf87dc09dc7 Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1919075906 Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:24:17.886618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:24:17.888059 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/489df5c12d274a23be1c0bf87dc09dc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/489df5c12d274a23be1c0bf87dc09dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_489df5c12d274a23be1c0bf87dc09dc7", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/489df5c12d274a23be1c0bf87dc09dc7"}]}] Jun 16 17:24:17.888059 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1919075906 Jun 16 17:24:17.888059 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 489df5c12d274a23be1c0bf87dc09dc7 Jun 16 17:24:17.888059 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1919075906 Jun 16 17:24:17.888059 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-VolumesSnapshotsTestJSON-1919075906-project Jun 16 17:24:17.888059 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:24:17.888059 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:24:17.888059 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: b8c37bfdb2384b838f6e5a0c7b0c1b4d Jun 16 17:24:17.888059 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1919075906-project Jun 16 17:24:17.888059 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: Jun 16 17:24:17.888059 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. Jun 16 17:24:17.888059 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': 'cb4e8609-8cc4-42c7-a6a9-b4fc511e221b'} Jun 16 17:24:17.888059 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. (HTTP 404) (Request-ID: req-7fbd6791-0545-44dd-acc9-7210a697bd0a) Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:17.892134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:24:17.893910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 17:24:17.895459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:24:17.896767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. Jun 16 17:24:17.896767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.896767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:17.896767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.896767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:17.896767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:17.896767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:17.896767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:24:17.896767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:24:17.896767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. Jun 16 17:24:17.896767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:17.896767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-6d7e0648-8c4d-4e4f-baaf-3d0ea6208396 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] Returning 404 to user: Volume cb4e8609-8cc4-42c7-a6a9-b4fc511e221b could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:24:17.896767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-6d7e0648-8c4d-4e4f-baaf-3d0ea6208396 tempest-VolumesSnapshotsTestJSON-1919075906 tempest-VolumesSnapshotsTestJSON-1919075906-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/cb4e8609-8cc4-42c7-a6a9-b4fc511e221b" status: 404 len: 109 microversion: 2.1 time: 0.070522 Jun 16 17:24:17.896767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 112/221] 10.222.0.66 () {58 vars in 1244 bytes} [Thu Jun 16 17:24:17 2022] GET /compute/v2.1/os-volumes/cb4e8609-8cc4-42c7-a6a9-b4fc511e221b => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:24:18.926744 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-34cfd9ea-34d1-4e5d-ac48-416b99c651bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:18.928594 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-34cfd9ea-34d1-4e5d-ac48-416b99c651bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:18.935814 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-34cfd9ea-34d1-4e5d-ac48-416b99c651bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:18.936343 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-34cfd9ea-34d1-4e5d-ac48-416b99c651bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:18.937141 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-34cfd9ea-34d1-4e5d-ac48-416b99c651bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:18.937781 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-34cfd9ea-34d1-4e5d-ac48-416b99c651bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:18.967343 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.objects.instance [None req-34cfd9ea-34d1-4e5d-ac48-416b99c651bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lazy-loading 'flavor' on Instance uuid 90ea9630-ef03-47fd-aa60-695a36081c19 {{(pid=117553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:24:19.106831 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-34cfd9ea-34d1-4e5d-ac48-416b99c651bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "POST /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19/action" status: 200 len: 32 microversion: 2.1 time: 0.184924 Jun 16 17:24:19.113081 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 110/222] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jun 16 17:24:18 2022] POST /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:24:19.119054 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b8adc507-5fd3-44a9-abc3-9e7bdfd4e7f2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:19.119656 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b8adc507-5fd3-44a9-abc3-9e7bdfd4e7f2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:19.127858 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b8adc507-5fd3-44a9-abc3-9e7bdfd4e7f2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:19.128300 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b8adc507-5fd3-44a9-abc3-9e7bdfd4e7f2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:19.129063 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b8adc507-5fd3-44a9-abc3-9e7bdfd4e7f2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:19.131363 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b8adc507-5fd3-44a9-abc3-9e7bdfd4e7f2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:19.470347 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-b8adc507-5fd3-44a9-abc3-9e7bdfd4e7f2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:19.513565 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b8adc507-5fd3-44a9-abc3-9e7bdfd4e7f2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.398427 Jun 16 17:24:19.518843 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 113/223] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:19 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:20.407262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-af57edf2-55c2-40cb-ac09-e0c4a8c7f3f5 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Action: 'create', calling method: .version_select at 0x7f66b1b149d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1018167223", "metadata": {"Type": "work"}}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-af57edf2-55c2-40cb-ac09-e0c4a8c7f3f5 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Request method failure captured: Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 122 Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2dDugr1s_W2oXn0DSBeVey3qJPjjPQPhKI0Mpo9_FTw9z44RfaLAPcoRuCAB-o29AVhLL99UfIz3391saCBao8vrNApeW62zGRAPfKf4xodA-iWhrvIfXC27l6A5oEfhmaX2q36Xz4Sp18HvWAqzPhlZOTD08phlSpF_rve4MYvaMM Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: 0d6d5610e5a240eeb78ae85ed576a672 Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:24:20.423499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:24:20.424694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d6d5610e5a240eeb78ae85ed576a672"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d6d5610e5a240eeb78ae85ed576a672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0d6d5610e5a240eeb78ae85ed576a672", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0d6d5610e5a240eeb78ae85ed576a672"}]}] Jun 16 17:24:20.424694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.424694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: 0d6d5610e5a240eeb78ae85ed576a672 Jun 16 17:24:20.424694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.424694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-VolumesNegativeTest-1582757672-project Jun 16 17:24:20.424694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:24:20.424694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:24:20.424694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: bdc51ac235e14df3bab3bd3e4fefc669 Jun 16 17:24:20.424694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-VolumesNegativeTest-1582757672-project Jun 16 17:24:20.424694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Jun 16 17:24:20.424694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1018167223", "metadata": {"Type": "work"}}} Jun 16 17:24:20.424694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: Jun 16 17:24:20.424694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1018167223', 'metadata': {'Type': 'work'}}}} Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise error Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:24:20.425761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 17:24:20.426922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 17:24:20.428082 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 17:24:20.428082 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.428082 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-af57edf2-55c2-40cb-ac09-e0c4a8c7f3f5 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:24:20.428082 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-af57edf2-55c2-40cb-ac09-e0c4a8c7f3f5 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.511909 Jun 16 17:24:20.428082 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 111/224] 10.222.0.66 () {60 vars in 1155 bytes} [Thu Jun 16 17:24:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 513 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:24:20.438040 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-925c439c-3058-4d17-98b5-258eb92073a9 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Action: 'create', calling method: .version_select at 0x7f66b188d280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1047031001", "metadata": {"Type": "work"}}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-925c439c-3058-4d17-98b5-258eb92073a9 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Request method failure captured: Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 120 Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2dDugr1s_W2oXn0DSBeVey3qJPjjPQPhKI0Mpo9_FTw9z44RfaLAPcoRuCAB-o29AVhLL99UfIz3391saCBao8vrNApeW62zGRAPfKf4xodA-iWhrvIfXC27l6A5oEfhmaX2q36Xz4Sp18HvWAqzPhlZOTD08phlSpF_rve4MYvaMM Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 0d6d5610e5a240eeb78ae85ed576a672 Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:24:20.444815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:24:20.446321 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d6d5610e5a240eeb78ae85ed576a672"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d6d5610e5a240eeb78ae85ed576a672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0d6d5610e5a240eeb78ae85ed576a672", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0d6d5610e5a240eeb78ae85ed576a672"}]}] Jun 16 17:24:20.446321 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.446321 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 0d6d5610e5a240eeb78ae85ed576a672 Jun 16 17:24:20.446321 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.446321 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-VolumesNegativeTest-1582757672-project Jun 16 17:24:20.446321 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:24:20.446321 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:24:20.446321 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: bdc51ac235e14df3bab3bd3e4fefc669 Jun 16 17:24:20.446321 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-VolumesNegativeTest-1582757672-project Jun 16 17:24:20.446321 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Jun 16 17:24:20.446321 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1047031001", "metadata": {"Type": "work"}}} Jun 16 17:24:20.446321 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: Jun 16 17:24:20.446321 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1047031001', 'metadata': {'Type': 'work'}}}} Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise error Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi '0' Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:24:20.447183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 17:24:20.448608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 17:24:20.450679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 17:24:20.450679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.455603 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-925c439c-3058-4d17-98b5-258eb92073a9 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:24:20.457825 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-925c439c-3058-4d17-98b5-258eb92073a9 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.026291 Jun 16 17:24:20.459966 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 114/225] 10.222.0.66 () {60 vars in 1155 bytes} [Thu Jun 16 17:24:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:24:20.480644 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-0e359a56-62b9-41df-b7dd-ca22ae6f85c7 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Action: 'create', calling method: .version_select at 0x7f66b1b14430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1037729445", "metadata": {"Type": "work"}}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-0e359a56-62b9-41df-b7dd-ca22ae6f85c7 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Request method failure captured: Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 119 Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2dDugr1s_W2oXn0DSBeVey3qJPjjPQPhKI0Mpo9_FTw9z44RfaLAPcoRuCAB-o29AVhLL99UfIz3391saCBao8vrNApeW62zGRAPfKf4xodA-iWhrvIfXC27l6A5oEfhmaX2q36Xz4Sp18HvWAqzPhlZOTD08phlSpF_rve4MYvaMM Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: 0d6d5610e5a240eeb78ae85ed576a672 Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:24:20.483741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:24:20.484916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d6d5610e5a240eeb78ae85ed576a672"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d6d5610e5a240eeb78ae85ed576a672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0d6d5610e5a240eeb78ae85ed576a672", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0d6d5610e5a240eeb78ae85ed576a672"}]}] Jun 16 17:24:20.484916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.484916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: 0d6d5610e5a240eeb78ae85ed576a672 Jun 16 17:24:20.484916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.484916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-VolumesNegativeTest-1582757672-project Jun 16 17:24:20.484916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:24:20.484916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:24:20.484916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: bdc51ac235e14df3bab3bd3e4fefc669 Jun 16 17:24:20.484916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-VolumesNegativeTest-1582757672-project Jun 16 17:24:20.484916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Jun 16 17:24:20.484916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1037729445", "metadata": {"Type": "work"}}} Jun 16 17:24:20.484916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: Jun 16 17:24:20.484916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1037729445', 'metadata': {'Type': 'work'}}}} Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise error Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi '' Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:24:20.485680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 17:24:20.486875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 17:24:20.487906 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 17:24:20.487906 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.489852 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-0e359a56-62b9-41df-b7dd-ca22ae6f85c7 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:24:20.491086 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-0e359a56-62b9-41df-b7dd-ca22ae6f85c7 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023298 Jun 16 17:24:20.491857 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 112/226] 10.222.0.66 () {60 vars in 1155 bytes} [Thu Jun 16 17:24:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:24:20.502678 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7e797fd0-1d77-4eea-ac97-9d0a62489096 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Calling method '.version_select at 0x7f66b1b24940>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:20.537524 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ebfc42ae-8a46-4114-b1c9-e9f97faf29e8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:20.538861 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ebfc42ae-8a46-4114-b1c9-e9f97faf29e8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:20.548772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-7e797fd0-1d77-4eea-ac97-9d0a62489096 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] HTTP exception thrown: Volume tempest-invalid-327660452 could not be found. Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7e797fd0-1d77-4eea-ac97-9d0a62489096 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Request method failure captured: Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-327660452 HTTP/1.1 Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2dDugr1s_W2oXn0DSBeVey3qJPjjPQPhKI0Mpo9_FTw9z44RfaLAPcoRuCAB-o29AVhLL99UfIz3391saCBao8vrNApeW62zGRAPfKf4xodA-iWhrvIfXC27l6A5oEfhmaX2q36Xz4Sp18HvWAqzPhlZOTD08phlSpF_rve4MYvaMM Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 0d6d5610e5a240eeb78ae85ed576a672 Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:24:20.551579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:24:20.552790 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d6d5610e5a240eeb78ae85ed576a672"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d6d5610e5a240eeb78ae85ed576a672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0d6d5610e5a240eeb78ae85ed576a672", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0d6d5610e5a240eeb78ae85ed576a672"}]}] Jun 16 17:24:20.552790 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.552790 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 0d6d5610e5a240eeb78ae85ed576a672 Jun 16 17:24:20.552790 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.552790 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-VolumesNegativeTest-1582757672-project Jun 16 17:24:20.552790 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:24:20.552790 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:24:20.552790 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: bdc51ac235e14df3bab3bd3e4fefc669 Jun 16 17:24:20.552790 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-VolumesNegativeTest-1582757672-project Jun 16 17:24:20.552790 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: Jun 16 17:24:20.552790 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Volume tempest-invalid-327660452 could not be found. Jun 16 17:24:20.552790 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': 'tempest-invalid-327660452'} Jun 16 17:24:20.552790 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-327660452 could not be found. (HTTP 404) (Request-ID: req-cccc1d03-b77d-4638-b794-d9e2b443fb00) Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:20.553662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:24:20.554772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-327660452 could not be found. Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:24:20.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-327660452 could not be found. Jun 16 17:24:20.560984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.560984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:20.560984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.560984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.560984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:20.560984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:20.560984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:24:20.560984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:24:20.560984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-327660452 could not be found. Jun 16 17:24:20.560984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.560984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7e797fd0-1d77-4eea-ac97-9d0a62489096 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Returning 404 to user: Volume tempest-invalid-327660452 could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:24:20.560984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7e797fd0-1d77-4eea-ac97-9d0a62489096 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-327660452" status: 404 len: 98 microversion: 2.1 time: 0.055039 Jun 16 17:24:20.560984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 115/227] 10.222.0.66 () {58 vars in 1214 bytes} [Thu Jun 16 17:24:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-327660452 => generated 98 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 17:24:20.565092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-34f98657-9576-44a4-8559-bfac4123ea04 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003926 Jun 16 17:24:20.570062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 116/228] 10.222.0.66 () {58 vars in 1139 bytes} [Thu Jun 16 17:24:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 17:24:20.571126 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ebfc42ae-8a46-4114-b1c9-e9f97faf29e8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:20.571419 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ebfc42ae-8a46-4114-b1c9-e9f97faf29e8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:20.572218 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ebfc42ae-8a46-4114-b1c9-e9f97faf29e8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:20.572676 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ebfc42ae-8a46-4114-b1c9-e9f97faf29e8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:20.579457 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-493e000a-d4f1-4b31-958f-645800000e8f tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004102 Jun 16 17:24:20.580283 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 117/229] 10.222.0.66 () {58 vars in 1136 bytes} [Thu Jun 16 17:24:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 17:24:20.592719 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b6395855-78b3-4f26-a908-aed294ea12f4 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Calling method '.version_select at 0x7f66b188d3a0>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:20.635463 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-b6395855-78b3-4f26-a908-aed294ea12f4 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] HTTP exception thrown: Volume c253bf0b-87bf-4302-822b-9f94ca38e833 could not be found. Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b6395855-78b3-4f26-a908-aed294ea12f4 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Request method failure captured: Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: DELETE /compute/v2.1/os-volumes/c253bf0b-87bf-4302-822b-9f94ca38e833 HTTP/1.1 Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2dDugr1s_W2oXn0DSBeVey3qJPjjPQPhKI0Mpo9_FTw9z44RfaLAPcoRuCAB-o29AVhLL99UfIz3391saCBao8vrNApeW62zGRAPfKf4xodA-iWhrvIfXC27l6A5oEfhmaX2q36Xz4Sp18HvWAqzPhlZOTD08phlSpF_rve4MYvaMM Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 0d6d5610e5a240eeb78ae85ed576a672 Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:24:20.638012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:24:20.639226 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d6d5610e5a240eeb78ae85ed576a672"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d6d5610e5a240eeb78ae85ed576a672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0d6d5610e5a240eeb78ae85ed576a672", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0d6d5610e5a240eeb78ae85ed576a672"}]}] Jun 16 17:24:20.639226 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.639226 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 0d6d5610e5a240eeb78ae85ed576a672 Jun 16 17:24:20.639226 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.639226 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-VolumesNegativeTest-1582757672-project Jun 16 17:24:20.639226 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:24:20.639226 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:24:20.639226 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: bdc51ac235e14df3bab3bd3e4fefc669 Jun 16 17:24:20.639226 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-VolumesNegativeTest-1582757672-project Jun 16 17:24:20.639226 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: Jun 16 17:24:20.639226 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Volume c253bf0b-87bf-4302-822b-9f94ca38e833 could not be found. Jun 16 17:24:20.639226 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': 'c253bf0b-87bf-4302-822b-9f94ca38e833'} Jun 16 17:24:20.639226 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c253bf0b-87bf-4302-822b-9f94ca38e833 could not be found. (HTTP 404) (Request-ID: req-4ed12863-7df5-44bf-809c-4a2397f022ed) Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:20.639954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:24:20.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c253bf0b-87bf-4302-822b-9f94ca38e833 could not be found. Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 17:24:20.642172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:24:20.643201 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c253bf0b-87bf-4302-822b-9f94ca38e833 could not be found. Jun 16 17:24:20.643201 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.643201 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:20.643201 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.643201 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.643201 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:20.643201 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:20.643201 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:24:20.643201 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:24:20.643201 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c253bf0b-87bf-4302-822b-9f94ca38e833 could not be found. Jun 16 17:24:20.643201 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.647731 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b6395855-78b3-4f26-a908-aed294ea12f4 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Returning 404 to user: Volume c253bf0b-87bf-4302-822b-9f94ca38e833 could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:24:20.648331 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b6395855-78b3-4f26-a908-aed294ea12f4 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/c253bf0b-87bf-4302-822b-9f94ca38e833" status: 404 len: 109 microversion: 2.1 time: 0.062313 Jun 16 17:24:20.649696 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 118/230] 10.222.0.66 () {58 vars in 1247 bytes} [Thu Jun 16 17:24:20 2022] DELETE /compute/v2.1/os-volumes/c253bf0b-87bf-4302-822b-9f94ca38e833 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:24:20.666760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d2f8a91d-ed33-44f0-a4d0-b3b083af59d2 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Calling method '.version_select at 0x7f66b1b88160>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:20.706543 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-d2f8a91d-ed33-44f0-a4d0-b3b083af59d2 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] HTTP exception thrown: Volume 0daac03c-1169-4f0c-bd75-9764fb5deac3 could not be found. Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d2f8a91d-ed33-44f0-a4d0-b3b083af59d2 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Request method failure captured: Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/os-volumes/0daac03c-1169-4f0c-bd75-9764fb5deac3 HTTP/1.1 Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2dDugr1s_W2oXn0DSBeVey3qJPjjPQPhKI0Mpo9_FTw9z44RfaLAPcoRuCAB-o29AVhLL99UfIz3391saCBao8vrNApeW62zGRAPfKf4xodA-iWhrvIfXC27l6A5oEfhmaX2q36Xz4Sp18HvWAqzPhlZOTD08phlSpF_rve4MYvaMM Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 0d6d5610e5a240eeb78ae85ed576a672 Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:24:20.708527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:24:20.709835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d6d5610e5a240eeb78ae85ed576a672"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d6d5610e5a240eeb78ae85ed576a672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0d6d5610e5a240eeb78ae85ed576a672", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0d6d5610e5a240eeb78ae85ed576a672"}]}] Jun 16 17:24:20.709835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.709835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 0d6d5610e5a240eeb78ae85ed576a672 Jun 16 17:24:20.709835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-VolumesNegativeTest-1582757672 Jun 16 17:24:20.709835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-VolumesNegativeTest-1582757672-project Jun 16 17:24:20.709835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:24:20.709835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:24:20.709835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: bdc51ac235e14df3bab3bd3e4fefc669 Jun 16 17:24:20.709835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-VolumesNegativeTest-1582757672-project Jun 16 17:24:20.709835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: Jun 16 17:24:20.709835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Volume 0daac03c-1169-4f0c-bd75-9764fb5deac3 could not be found. Jun 16 17:24:20.709835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': '0daac03c-1169-4f0c-bd75-9764fb5deac3'} Jun 16 17:24:20.709835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0daac03c-1169-4f0c-bd75-9764fb5deac3 could not be found. (HTTP 404) (Request-ID: req-ee5b655a-39e3-48d3-af4c-4291c723f53a) Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:20.710578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:24:20.711679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0daac03c-1169-4f0c-bd75-9764fb5deac3 could not be found. Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 17:24:20.714988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:24:20.716499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0daac03c-1169-4f0c-bd75-9764fb5deac3 could not be found. Jun 16 17:24:20.716499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.716499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:20.716499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.716499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:20.716499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:20.716499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:20.716499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:24:20.716499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:24:20.716499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0daac03c-1169-4f0c-bd75-9764fb5deac3 could not be found. Jun 16 17:24:20.716499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:20.716499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d2f8a91d-ed33-44f0-a4d0-b3b083af59d2 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] Returning 404 to user: Volume 0daac03c-1169-4f0c-bd75-9764fb5deac3 could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:24:20.716499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d2f8a91d-ed33-44f0-a4d0-b3b083af59d2 tempest-VolumesNegativeTest-1582757672 tempest-VolumesNegativeTest-1582757672-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/0daac03c-1169-4f0c-bd75-9764fb5deac3" status: 404 len: 109 microversion: 2.1 time: 0.053923 Jun 16 17:24:20.716499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 119/231] 10.222.0.66 () {58 vars in 1244 bytes} [Thu Jun 16 17:24:20 2022] GET /compute/v2.1/os-volumes/0daac03c-1169-4f0c-bd75-9764fb5deac3 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:24:20.784610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ebfc42ae-8a46-4114-b1c9-e9f97faf29e8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:20.795045 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ebfc42ae-8a46-4114-b1c9-e9f97faf29e8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.265093 Jun 16 17:24:20.796093 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 113/232] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:20 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:24:21.812459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b998e802-476b-45dc-b3cd-5db5747fa4f2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:21.814190 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b998e802-476b-45dc-b3cd-5db5747fa4f2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:21.823370 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b998e802-476b-45dc-b3cd-5db5747fa4f2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:21.824632 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b998e802-476b-45dc-b3cd-5db5747fa4f2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:21.825787 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b998e802-476b-45dc-b3cd-5db5747fa4f2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:21.826587 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b998e802-476b-45dc-b3cd-5db5747fa4f2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:22.045016 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-b998e802-476b-45dc-b3cd-5db5747fa4f2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:22.058415 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b998e802-476b-45dc-b3cd-5db5747fa4f2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.247763 Jun 16 17:24:22.059049 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 120/233] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:21 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:24:23.076074 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-bcc1e468-b5a4-41e9-a58e-4838f1e58e5c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:23.076645 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-bcc1e468-b5a4-41e9-a58e-4838f1e58e5c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:23.084030 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bcc1e468-b5a4-41e9-a58e-4838f1e58e5c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:23.084596 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bcc1e468-b5a4-41e9-a58e-4838f1e58e5c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:23.085401 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bcc1e468-b5a4-41e9-a58e-4838f1e58e5c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:23.085864 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bcc1e468-b5a4-41e9-a58e-4838f1e58e5c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:23.239884 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-bcc1e468-b5a4-41e9-a58e-4838f1e58e5c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:23.247918 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-bcc1e468-b5a4-41e9-a58e-4838f1e58e5c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.175992 Jun 16 17:24:23.248664 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 114/234] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:23 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:24.266113 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-6cea57a5-04e4-4a49-9dfa-1704028a3f8c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:24.267024 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-6cea57a5-04e4-4a49-9dfa-1704028a3f8c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:24.274267 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6cea57a5-04e4-4a49-9dfa-1704028a3f8c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:24.274970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6cea57a5-04e4-4a49-9dfa-1704028a3f8c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:24.275826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6cea57a5-04e4-4a49-9dfa-1704028a3f8c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:24.276258 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6cea57a5-04e4-4a49-9dfa-1704028a3f8c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:24.425861 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-6cea57a5-04e4-4a49-9dfa-1704028a3f8c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:24.433679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-6cea57a5-04e4-4a49-9dfa-1704028a3f8c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.171450 Jun 16 17:24:24.434530 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 121/235] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:24 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:25.451459 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2b106a0c-3311-4b1f-9823-e6eb7ddec626 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:25.452188 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2b106a0c-3311-4b1f-9823-e6eb7ddec626 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:25.458659 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2b106a0c-3311-4b1f-9823-e6eb7ddec626 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:25.459103 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2b106a0c-3311-4b1f-9823-e6eb7ddec626 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:25.459860 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2b106a0c-3311-4b1f-9823-e6eb7ddec626 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:25.460284 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2b106a0c-3311-4b1f-9823-e6eb7ddec626 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:25.678509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2b106a0c-3311-4b1f-9823-e6eb7ddec626 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:25.686882 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2b106a0c-3311-4b1f-9823-e6eb7ddec626 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.239247 Jun 16 17:24:25.688033 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 115/236] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:25 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:26.709617 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ffa58c36-efb7-4a10-b552-bf339123d75d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:26.710677 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ffa58c36-efb7-4a10-b552-bf339123d75d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:26.727949 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ffa58c36-efb7-4a10-b552-bf339123d75d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:26.728773 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ffa58c36-efb7-4a10-b552-bf339123d75d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:26.730142 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ffa58c36-efb7-4a10-b552-bf339123d75d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:26.730879 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ffa58c36-efb7-4a10-b552-bf339123d75d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:26.906168 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ffa58c36-efb7-4a10-b552-bf339123d75d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:26.917674 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ffa58c36-efb7-4a10-b552-bf339123d75d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.215341 Jun 16 17:24:26.918557 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 122/237] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:26 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:27.937251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-87ccbcc3-f9b0-47b9-8de7-eee05514c402 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:27.938075 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-87ccbcc3-f9b0-47b9-8de7-eee05514c402 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:27.944952 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-87ccbcc3-f9b0-47b9-8de7-eee05514c402 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:27.945476 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-87ccbcc3-f9b0-47b9-8de7-eee05514c402 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:27.946245 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-87ccbcc3-f9b0-47b9-8de7-eee05514c402 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:27.946666 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-87ccbcc3-f9b0-47b9-8de7-eee05514c402 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:28.132116 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-87ccbcc3-f9b0-47b9-8de7-eee05514c402 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:28.142154 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-87ccbcc3-f9b0-47b9-8de7-eee05514c402 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.209181 Jun 16 17:24:28.142770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 116/238] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:27 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:28.962775 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ceb418b5-112c-4079-a55a-3c090c72972b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1848276462", "imageRef": "c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1", "flavorRef": "452"}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:29.021224 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.network.neutron [None req-ceb418b5-112c-4079-a55a-3c090c72972b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] validate_networks() for None {{(pid=117552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:24:29.161457 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-fc6d806d-8c89-4af9-a512-074ba6da6979 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:29.162073 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-fc6d806d-8c89-4af9-a512-074ba6da6979 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:29.170010 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fc6d806d-8c89-4af9-a512-074ba6da6979 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:29.170456 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fc6d806d-8c89-4af9-a512-074ba6da6979 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:29.171455 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fc6d806d-8c89-4af9-a512-074ba6da6979 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:29.171869 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fc6d806d-8c89-4af9-a512-074ba6da6979 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:29.176519 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:24:29.343879 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-fc6d806d-8c89-4af9-a512-074ba6da6979 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:29.354043 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-fc6d806d-8c89-4af9-a512-074ba6da6979 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.197936 Jun 16 17:24:29.354865 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 117/239] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:29 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:29.507373 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-ceb418b5-112c-4079-a55a-3c090c72972b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Flavor limits 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:24:29.507867 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-ceb418b5-112c-4079-a55a-3c090c72972b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Image limits 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:24:29.508337 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-ceb418b5-112c-4079-a55a-3c090c72972b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Flavor pref 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:24:29.508820 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-ceb418b5-112c-4079-a55a-3c090c72972b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Image pref 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:24:29.509400 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-ceb418b5-112c-4079-a55a-3c090c72972b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:24:29.521673 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ceb418b5-112c-4079-a55a-3c090c72972b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:29.522323 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ceb418b5-112c-4079-a55a-3c090c72972b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:29.525016 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ceb418b5-112c-4079-a55a-3c090c72972b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:29.525016 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ceb418b5-112c-4079-a55a-3c090c72972b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:29.549814 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-ceb418b5-112c-4079-a55a-3c090c72972b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Getting quotas for project 9d89beafb10246f7b9087ca7cd75f239. Resources: {'cores', 'instances', 'ram'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:24:29.554468 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-ceb418b5-112c-4079-a55a-3c090c72972b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Getting quotas for user da4b12d5d8f647589a2226303b01c2f3 and project 9d89beafb10246f7b9087ca7cd75f239. Resources: {'cores', 'instances', 'ram'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:24:29.568510 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ceb418b5-112c-4079-a55a-3c090c72972b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Going to run 1 instances... {{(pid=117552) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:24:29.571438 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ceb418b5-112c-4079-a55a-3c090c72972b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:24:29.617696 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ceb418b5-112c-4079-a55a-3c090c72972b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659877 Jun 16 17:24:29.618527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 123/240] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:24:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 17:24:29.629556 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-815f97be-5027-40a3-87df-bbd2bb1b9681 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:29.630349 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-815f97be-5027-40a3-87df-bbd2bb1b9681 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:29.633533 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=32 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:24:29.688957 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-815f97be-5027-40a3-87df-bbd2bb1b9681 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:29.699748 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-815f97be-5027-40a3-87df-bbd2bb1b9681 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1215 microversion: 2.1 time: 0.074755 Jun 16 17:24:29.700401 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 118/241] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:29 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:30.372295 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-87d5fc12-9bee-4d32-a41c-1bf14aa81766 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:30.373565 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-87d5fc12-9bee-4d32-a41c-1bf14aa81766 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:30.380113 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-87d5fc12-9bee-4d32-a41c-1bf14aa81766 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:30.380559 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-87d5fc12-9bee-4d32-a41c-1bf14aa81766 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:30.381754 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-87d5fc12-9bee-4d32-a41c-1bf14aa81766 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:30.382459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-87d5fc12-9bee-4d32-a41c-1bf14aa81766 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:30.385591 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=94 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:24:30.543642 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-87d5fc12-9bee-4d32-a41c-1bf14aa81766 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:30.555415 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-87d5fc12-9bee-4d32-a41c-1bf14aa81766 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.186799 Jun 16 17:24:30.556343 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 124/242] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:30 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:30.718188 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-9bd3f80f-bd3d-4e5d-a5a8-95249117cad5 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:30.719280 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-9bd3f80f-bd3d-4e5d-a5a8-95249117cad5 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:30.725687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9bd3f80f-bd3d-4e5d-a5a8-95249117cad5 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:30.726144 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9bd3f80f-bd3d-4e5d-a5a8-95249117cad5 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:30.727043 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9bd3f80f-bd3d-4e5d-a5a8-95249117cad5 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:30.727472 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9bd3f80f-bd3d-4e5d-a5a8-95249117cad5 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:30.801541 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-9bd3f80f-bd3d-4e5d-a5a8-95249117cad5 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:30.814599 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-9bd3f80f-bd3d-4e5d-a5a8-95249117cad5 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1219 microversion: 2.1 time: 0.099964 Jun 16 17:24:30.815540 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 119/243] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:30 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:31.578713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-4aae5ff6-e2ab-4498-949d-7a6b6d8a98c7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:31.579297 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-4aae5ff6-e2ab-4498-949d-7a6b6d8a98c7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:31.586241 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4aae5ff6-e2ab-4498-949d-7a6b6d8a98c7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:31.586778 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4aae5ff6-e2ab-4498-949d-7a6b6d8a98c7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:31.587678 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4aae5ff6-e2ab-4498-949d-7a6b6d8a98c7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:31.588191 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4aae5ff6-e2ab-4498-949d-7a6b6d8a98c7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:31.736854 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-4aae5ff6-e2ab-4498-949d-7a6b6d8a98c7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:31.746338 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-4aae5ff6-e2ab-4498-949d-7a6b6d8a98c7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.171410 Jun 16 17:24:31.746824 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 125/244] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:31 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:31.839393 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-cf14bf8b-bd02-448c-a9ef-a4285e879c97 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:31.840747 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-cf14bf8b-bd02-448c-a9ef-a4285e879c97 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:31.852073 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cf14bf8b-bd02-448c-a9ef-a4285e879c97 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:31.852754 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cf14bf8b-bd02-448c-a9ef-a4285e879c97 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:31.854963 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cf14bf8b-bd02-448c-a9ef-a4285e879c97 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:31.855279 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cf14bf8b-bd02-448c-a9ef-a4285e879c97 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:31.978338 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-cf14bf8b-bd02-448c-a9ef-a4285e879c97 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:31.988969 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-cf14bf8b-bd02-448c-a9ef-a4285e879c97 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1219 microversion: 2.1 time: 0.157414 Jun 16 17:24:31.989908 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 120/245] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:31 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:32.764955 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-359ebcda-bb15-4040-89ca-f340b0fdd928 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:32.766083 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-359ebcda-bb15-4040-89ca-f340b0fdd928 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:32.773098 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-359ebcda-bb15-4040-89ca-f340b0fdd928 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:32.773593 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-359ebcda-bb15-4040-89ca-f340b0fdd928 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:32.774477 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-359ebcda-bb15-4040-89ca-f340b0fdd928 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:32.774906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-359ebcda-bb15-4040-89ca-f340b0fdd928 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:33.007927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5328c1b4-5803-4dd2-9663-def28f80b16b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:33.010055 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5328c1b4-5803-4dd2-9663-def28f80b16b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:33.023421 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5328c1b4-5803-4dd2-9663-def28f80b16b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:33.025642 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5328c1b4-5803-4dd2-9663-def28f80b16b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:33.028606 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5328c1b4-5803-4dd2-9663-def28f80b16b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:33.029319 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5328c1b4-5803-4dd2-9663-def28f80b16b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:33.159345 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-5328c1b4-5803-4dd2-9663-def28f80b16b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:33.177154 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5328c1b4-5803-4dd2-9663-def28f80b16b tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1273 microversion: 2.1 time: 0.173140 Jun 16 17:24:33.178620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 121/246] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:33 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:24:33.187459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-359ebcda-bb15-4040-89ca-f340b0fdd928 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:33.202287 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-359ebcda-bb15-4040-89ca-f340b0fdd928 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.441144 Jun 16 17:24:33.203705 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 126/247] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:32 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:24:34.198433 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c3ab5983-f464-412a-8096-7b03aa22b765 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:34.199043 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c3ab5983-f464-412a-8096-7b03aa22b765 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:34.207828 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c3ab5983-f464-412a-8096-7b03aa22b765 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:34.208519 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c3ab5983-f464-412a-8096-7b03aa22b765 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:34.209519 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c3ab5983-f464-412a-8096-7b03aa22b765 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:34.210286 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c3ab5983-f464-412a-8096-7b03aa22b765 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:34.221688 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ee181689-7c44-4aae-8b35-48505d6a5118 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:34.222649 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ee181689-7c44-4aae-8b35-48505d6a5118 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:34.230041 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ee181689-7c44-4aae-8b35-48505d6a5118 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:34.230494 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ee181689-7c44-4aae-8b35-48505d6a5118 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:34.231294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ee181689-7c44-4aae-8b35-48505d6a5118 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:34.231904 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ee181689-7c44-4aae-8b35-48505d6a5118 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:34.384029 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ee181689-7c44-4aae-8b35-48505d6a5118 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:34.393661 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c3ab5983-f464-412a-8096-7b03aa22b765 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:34.393870 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ee181689-7c44-4aae-8b35-48505d6a5118 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.175802 Jun 16 17:24:34.394498 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 127/248] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:34 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:24:34.402362 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c3ab5983-f464-412a-8096-7b03aa22b765 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1315 microversion: 2.1 time: 0.209709 Jun 16 17:24:34.403412 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 122/249] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:34 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:35.420118 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-3c6d82d4-bab5-4610-9b2c-3f372874a17d tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:35.420759 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-3c6d82d4-bab5-4610-9b2c-3f372874a17d tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:35.425836 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ae2b7c83-2c73-4cc5-9873-2bd3ea471138 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:35.426760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ae2b7c83-2c73-4cc5-9873-2bd3ea471138 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:35.433581 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3c6d82d4-bab5-4610-9b2c-3f372874a17d tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:35.434324 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3c6d82d4-bab5-4610-9b2c-3f372874a17d tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:35.435103 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3c6d82d4-bab5-4610-9b2c-3f372874a17d tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:35.435530 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3c6d82d4-bab5-4610-9b2c-3f372874a17d tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:35.436280 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ae2b7c83-2c73-4cc5-9873-2bd3ea471138 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:35.436701 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ae2b7c83-2c73-4cc5-9873-2bd3ea471138 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:35.437685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ae2b7c83-2c73-4cc5-9873-2bd3ea471138 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:35.438267 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ae2b7c83-2c73-4cc5-9873-2bd3ea471138 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:35.589665 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-3c6d82d4-bab5-4610-9b2c-3f372874a17d tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:35.597635 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-3c6d82d4-bab5-4610-9b2c-3f372874a17d tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1315 microversion: 2.1 time: 0.181294 Jun 16 17:24:35.598354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 123/250] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:35 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:35.664385 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ae2b7c83-2c73-4cc5-9873-2bd3ea471138 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:35.673882 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ae2b7c83-2c73-4cc5-9873-2bd3ea471138 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.263590 Jun 16 17:24:35.675132 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 128/251] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:35 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:36.004930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-de89aebc-04e2-4616-b3ec-4e63f92063ec req-9c328849-9717-415a-b862-35a602e53bfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e2df49-edf7-4ed4-b8fe-bcc61f5d0807", "tag": "2ba9ec91-2d6b-4395-ba81-e0d7dc6364ff"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:36.014921 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-de89aebc-04e2-4616-b3ec-4e63f92063ec req-9c328849-9717-415a-b862-35a602e53bfb service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:36.015476 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-de89aebc-04e2-4616-b3ec-4e63f92063ec req-9c328849-9717-415a-b862-35a602e53bfb service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:36.029607 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-de89aebc-04e2-4616-b3ec-4e63f92063ec req-9c328849-9717-415a-b862-35a602e53bfb service nova] Creating event network-changed:2ba9ec91-2d6b-4395-ba81-e0d7dc6364ff for instance 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 on hv-cinder-83735 Jun 16 17:24:36.035061 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-de89aebc-04e2-4616-b3ec-4e63f92063ec req-9c328849-9717-415a-b862-35a602e53bfb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036005 Jun 16 17:24:36.035866 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 124/252] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:24:36.615259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-47441157-45ca-4422-86cf-90e656d506fa tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:36.615874 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-47441157-45ca-4422-86cf-90e656d506fa tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:36.622805 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-47441157-45ca-4422-86cf-90e656d506fa tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:36.623249 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-47441157-45ca-4422-86cf-90e656d506fa tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:36.624018 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-47441157-45ca-4422-86cf-90e656d506fa tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:36.624609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-47441157-45ca-4422-86cf-90e656d506fa tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:36.694369 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c5154a4a-61e0-40c3-bdef-a59018c474de tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:36.694369 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c5154a4a-61e0-40c3-bdef-a59018c474de tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:36.701201 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c5154a4a-61e0-40c3-bdef-a59018c474de tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:36.701723 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c5154a4a-61e0-40c3-bdef-a59018c474de tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:36.702579 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c5154a4a-61e0-40c3-bdef-a59018c474de tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:36.703066 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c5154a4a-61e0-40c3-bdef-a59018c474de tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:36.766049 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-47441157-45ca-4422-86cf-90e656d506fa tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:36.777516 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-47441157-45ca-4422-86cf-90e656d506fa tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1315 microversion: 2.1 time: 0.166334 Jun 16 17:24:36.778452 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 129/253] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:36 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:36.850291 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c5154a4a-61e0-40c3-bdef-a59018c474de tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:36.858637 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c5154a4a-61e0-40c3-bdef-a59018c474de tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.170285 Jun 16 17:24:36.859230 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 125/254] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:36 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:24:37.795407 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-432482f8-86bc-478b-b568-82d47d9fbb98 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:37.796172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-432482f8-86bc-478b-b568-82d47d9fbb98 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:37.798235 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:24:37.803927 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-432482f8-86bc-478b-b568-82d47d9fbb98 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:37.804613 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-432482f8-86bc-478b-b568-82d47d9fbb98 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:37.805576 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-432482f8-86bc-478b-b568-82d47d9fbb98 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:37.806003 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-432482f8-86bc-478b-b568-82d47d9fbb98 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:37.876576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d9a74e54-8508-4f9b-8866-9fa1d08dd8cc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:37.877973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-d9a74e54-8508-4f9b-8866-9fa1d08dd8cc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:37.885430 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d9a74e54-8508-4f9b-8866-9fa1d08dd8cc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:37.887252 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d9a74e54-8508-4f9b-8866-9fa1d08dd8cc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:37.888345 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d9a74e54-8508-4f9b-8866-9fa1d08dd8cc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:37.889580 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d9a74e54-8508-4f9b-8866-9fa1d08dd8cc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:37.968961 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-432482f8-86bc-478b-b568-82d47d9fbb98 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:37.978293 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-432482f8-86bc-478b-b568-82d47d9fbb98 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1315 microversion: 2.1 time: 0.186658 Jun 16 17:24:37.979156 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 130/255] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:37 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:38.236606 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d9a74e54-8508-4f9b-8866-9fa1d08dd8cc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:38.245022 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-d9a74e54-8508-4f9b-8866-9fa1d08dd8cc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.372601 Jun 16 17:24:38.245692 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 126/256] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:37 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:38.997471 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c17ace28-c288-4863-b200-5e7beb5ec386 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:38.998177 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c17ace28-c288-4863-b200-5e7beb5ec386 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:39.006614 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c17ace28-c288-4863-b200-5e7beb5ec386 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:39.007335 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c17ace28-c288-4863-b200-5e7beb5ec386 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:39.008943 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c17ace28-c288-4863-b200-5e7beb5ec386 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:39.010116 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c17ace28-c288-4863-b200-5e7beb5ec386 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:39.165924 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c17ace28-c288-4863-b200-5e7beb5ec386 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:39.177532 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c17ace28-c288-4863-b200-5e7beb5ec386 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1315 microversion: 2.1 time: 0.184058 Jun 16 17:24:39.178400 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 131/257] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:38 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:39.267806 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ba8f4fb9-e3ce-44f8-9358-8e72b4d2af67 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:39.269160 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ba8f4fb9-e3ce-44f8-9358-8e72b4d2af67 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:39.288503 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ba8f4fb9-e3ce-44f8-9358-8e72b4d2af67 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:39.289298 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ba8f4fb9-e3ce-44f8-9358-8e72b4d2af67 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:39.290627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ba8f4fb9-e3ce-44f8-9358-8e72b4d2af67 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:39.291422 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ba8f4fb9-e3ce-44f8-9358-8e72b4d2af67 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:39.440470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ba8f4fb9-e3ce-44f8-9358-8e72b4d2af67 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:39.449055 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ba8f4fb9-e3ce-44f8-9358-8e72b4d2af67 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.189728 Jun 16 17:24:39.449998 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 127/258] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:39 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:24:40.205333 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d2b6fb0a-7b37-4b8f-b911-1b76693a4b69 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:40.206010 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d2b6fb0a-7b37-4b8f-b911-1b76693a4b69 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:40.208251 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:24:40.209650 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=6 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:24:40.216155 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d2b6fb0a-7b37-4b8f-b911-1b76693a4b69 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:40.216682 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d2b6fb0a-7b37-4b8f-b911-1b76693a4b69 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:40.217714 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d2b6fb0a-7b37-4b8f-b911-1b76693a4b69 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:40.218233 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d2b6fb0a-7b37-4b8f-b911-1b76693a4b69 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:40.374019 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d2b6fb0a-7b37-4b8f-b911-1b76693a4b69 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:40.384540 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d2b6fb0a-7b37-4b8f-b911-1b76693a4b69 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1315 microversion: 2.1 time: 0.183725 Jun 16 17:24:40.385099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 132/259] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:40 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:40.468287 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ba79ca7f-f9d1-4d1d-8fc1-2398f5569bee tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:40.468925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ba79ca7f-f9d1-4d1d-8fc1-2398f5569bee tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:40.471384 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:24:40.478957 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ba79ca7f-f9d1-4d1d-8fc1-2398f5569bee tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:40.479553 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ba79ca7f-f9d1-4d1d-8fc1-2398f5569bee tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:40.480531 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ba79ca7f-f9d1-4d1d-8fc1-2398f5569bee tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:40.480966 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ba79ca7f-f9d1-4d1d-8fc1-2398f5569bee tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:40.626935 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ba79ca7f-f9d1-4d1d-8fc1-2398f5569bee tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:40.635685 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ba79ca7f-f9d1-4d1d-8fc1-2398f5569bee tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.171154 Jun 16 17:24:40.636240 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 128/260] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:40 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:41.402931 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-fffc6748-0727-4427-bece-e96496176d13 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:41.404437 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-fffc6748-0727-4427-bece-e96496176d13 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:41.410159 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fffc6748-0727-4427-bece-e96496176d13 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:41.410581 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fffc6748-0727-4427-bece-e96496176d13 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:41.411378 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fffc6748-0727-4427-bece-e96496176d13 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:41.411872 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fffc6748-0727-4427-bece-e96496176d13 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:41.579720 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-fffc6748-0727-4427-bece-e96496176d13 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:41.588898 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-fffc6748-0727-4427-bece-e96496176d13 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1315 microversion: 2.1 time: 0.190489 Jun 16 17:24:41.589962 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 133/261] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:41 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:41.653116 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c8267727-0681-46e7-869a-c72f0efa3cf8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:41.654454 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c8267727-0681-46e7-869a-c72f0efa3cf8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:41.661319 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c8267727-0681-46e7-869a-c72f0efa3cf8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:41.661764 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c8267727-0681-46e7-869a-c72f0efa3cf8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:41.662600 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c8267727-0681-46e7-869a-c72f0efa3cf8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:41.663397 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c8267727-0681-46e7-869a-c72f0efa3cf8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:41.821317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c8267727-0681-46e7-869a-c72f0efa3cf8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:41.833210 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c8267727-0681-46e7-869a-c72f0efa3cf8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.184659 Jun 16 17:24:41.833996 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 129/262] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:41 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:42.606995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8e096dd3-fc15-41d9-839e-b263598579d7 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:42.608171 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8e096dd3-fc15-41d9-839e-b263598579d7 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:42.615054 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8e096dd3-fc15-41d9-839e-b263598579d7 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:42.615594 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8e096dd3-fc15-41d9-839e-b263598579d7 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:42.616452 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8e096dd3-fc15-41d9-839e-b263598579d7 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:42.616891 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8e096dd3-fc15-41d9-839e-b263598579d7 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:42.789763 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8e096dd3-fc15-41d9-839e-b263598579d7 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:42.804734 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8e096dd3-fc15-41d9-839e-b263598579d7 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1315 microversion: 2.1 time: 0.202309 Jun 16 17:24:42.806428 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 134/263] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:42 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:42.862137 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7152356b-f87a-4a25-a132-966cb6cc3fe7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:42.865027 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-7152356b-f87a-4a25-a132-966cb6cc3fe7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:42.879589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7152356b-f87a-4a25-a132-966cb6cc3fe7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:42.881013 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7152356b-f87a-4a25-a132-966cb6cc3fe7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:42.883191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7152356b-f87a-4a25-a132-966cb6cc3fe7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:42.884447 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7152356b-f87a-4a25-a132-966cb6cc3fe7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:43.061683 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7152356b-f87a-4a25-a132-966cb6cc3fe7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:43.070625 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7152356b-f87a-4a25-a132-966cb6cc3fe7 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.217687 Jun 16 17:24:43.071217 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 130/264] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:42 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:43.838564 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-49f83b03-bf77-4c70-8b05-99096fb21b2a tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:43.839159 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-49f83b03-bf77-4c70-8b05-99096fb21b2a tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:43.847024 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-49f83b03-bf77-4c70-8b05-99096fb21b2a tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:43.848324 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-49f83b03-bf77-4c70-8b05-99096fb21b2a tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:43.854352 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-49f83b03-bf77-4c70-8b05-99096fb21b2a tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:43.854958 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-49f83b03-bf77-4c70-8b05-99096fb21b2a tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:44.046656 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-49f83b03-bf77-4c70-8b05-99096fb21b2a tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:44.056739 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-49f83b03-bf77-4c70-8b05-99096fb21b2a tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1315 microversion: 2.1 time: 0.226867 Jun 16 17:24:44.070593 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 135/265] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:43 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:44.090826 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2718f997-9253-472b-842a-7c1f78fb3900 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:44.091443 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2718f997-9253-472b-842a-7c1f78fb3900 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:44.112357 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2718f997-9253-472b-842a-7c1f78fb3900 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:44.113234 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2718f997-9253-472b-842a-7c1f78fb3900 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:44.114080 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2718f997-9253-472b-842a-7c1f78fb3900 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:44.114515 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2718f997-9253-472b-842a-7c1f78fb3900 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:44.392118 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2718f997-9253-472b-842a-7c1f78fb3900 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:44.408955 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2718f997-9253-472b-842a-7c1f78fb3900 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1501 microversion: 2.1 time: 0.324570 Jun 16 17:24:44.411043 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 131/266] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:44 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1501 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:44.437294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9099c710-34ba-4686-888f-02fd2604f43d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ecd3000-0a85-487e-8a10-c8b35669429b"}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:44.439311 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-9099c710-34ba-4686-888f-02fd2604f43d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:44.453597 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9099c710-34ba-4686-888f-02fd2604f43d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:44.454355 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9099c710-34ba-4686-888f-02fd2604f43d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:44.460663 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9099c710-34ba-4686-888f-02fd2604f43d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:44.460663 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9099c710-34ba-4686-888f-02fd2604f43d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:44.521584 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-9099c710-34ba-4686-888f-02fd2604f43d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] HTTP exception thrown: Cannot 'attach_volume' instance 90ea9630-ef03-47fd-aa60-695a36081c19 while it is in vm_state rescued Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9099c710-34ba-4686-888f-02fd2604f43d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Request method failure captured: Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: POST /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19/os-volume_attachments HTTP/1.1 Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 74 Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2baiTAiiIqvs05AAgXEGNrzgTOS0KD51O8IrwALK_82kaIh4oIhGWJGUbDxg3s9UADdVPKzO_ZDdu65W2o4SzEeVM38vngvZj4zT9_ojpKoesbQIclVOSFNU9SjyczrwaH1BGy99G4f7f3jUdIV6_zsnlingiczP1owxkwlv_alFaA Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: ccf5c45783454fc5a7872490196f07e0 Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1475515620 Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:24:44.526062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:24:44.528619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ccf5c45783454fc5a7872490196f07e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ccf5c45783454fc5a7872490196f07e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ccf5c45783454fc5a7872490196f07e0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ccf5c45783454fc5a7872490196f07e0"}]}] Jun 16 17:24:44.528619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1475515620 Jun 16 17:24:44.528619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: ccf5c45783454fc5a7872490196f07e0 Jun 16 17:24:44.528619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1475515620 Jun 16 17:24:44.528619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-ServerRescueNegativeTestJSON-1475515620-project Jun 16 17:24:44.528619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:24:44.528619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:24:44.528619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 0cd8a309f6914d83b8e72bc60a5d7924 Jun 16 17:24:44.528619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1475515620-project Jun 16 17:24:44.528619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Jun 16 17:24:44.528619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {"volumeAttachment": {"volumeId": "1ecd3000-0a85-487e-8a10-c8b35669429b"}} Jun 16 17:24:44.528619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Cannot 'attach_volume' instance 90ea9630-ef03-47fd-aa60-695a36081c19 while it is in vm_state rescued Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'server_id': '90ea9630-ef03-47fd-aa60-695a36081c19', 'body': {'volumeAttachment': {'volumeId': '1ecd3000-0a85-487e-8a10-c8b35669429b'}}} Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90ea9630-ef03-47fd-aa60-695a36081c19 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:24:44.530429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 90ea9630-ef03-47fd-aa60-695a36081c19 while it is in vm_state rescued Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:44.532221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:44.535763 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:24:44.535763 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:24:44.535763 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 90ea9630-ef03-47fd-aa60-695a36081c19 while it is in vm_state rescued Jun 16 17:24:44.535763 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:24:44.538820 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9099c710-34ba-4686-888f-02fd2604f43d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Returning 409 to user: Cannot 'attach_volume' instance 90ea9630-ef03-47fd-aa60-695a36081c19 while it is in vm_state rescued {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:24:44.547664 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9099c710-34ba-4686-888f-02fd2604f43d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "POST /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.115058 Jun 16 17:24:44.549224 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 136/267] 10.222.0.66 () {60 vars in 1322 bytes} [Thu Jun 16 17:24:44 2022] POST /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19/os-volume_attachments => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 16 17:24:44.561463 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a5703524-0c7b-4fcb-8df6-3c0a131ece67 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:44.562296 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a5703524-0c7b-4fcb-8df6-3c0a131ece67 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:44.573709 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a5703524-0c7b-4fcb-8df6-3c0a131ece67 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:44.574470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a5703524-0c7b-4fcb-8df6-3c0a131ece67 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:44.576280 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a5703524-0c7b-4fcb-8df6-3c0a131ece67 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:44.577003 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a5703524-0c7b-4fcb-8df6-3c0a131ece67 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:44.620161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-99da698d-7cdb-4caa-91a6-87cb3dc1f58b req-83922c20-e817-4071-ae69-17ac69fcef91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e2df49-edf7-4ed4-b8fe-bcc61f5d0807", "name": "network-vif-plugged", "status": "completed", "tag": "2ba9ec91-2d6b-4395-ba81-e0d7dc6364ff"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:44.654938 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-99da698d-7cdb-4caa-91a6-87cb3dc1f58b req-83922c20-e817-4071-ae69-17ac69fcef91 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:44.655438 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-99da698d-7cdb-4caa-91a6-87cb3dc1f58b req-83922c20-e817-4071-ae69-17ac69fcef91 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:44.691400 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-99da698d-7cdb-4caa-91a6-87cb3dc1f58b req-83922c20-e817-4071-ae69-17ac69fcef91 service nova] Creating event network-vif-plugged:2ba9ec91-2d6b-4395-ba81-e0d7dc6364ff for instance 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 on hv-cinder-83735 Jun 16 17:24:44.698940 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-99da698d-7cdb-4caa-91a6-87cb3dc1f58b req-83922c20-e817-4071-ae69-17ac69fcef91 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089129 Jun 16 17:24:44.700399 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 137/268] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:24:44.724768 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a5703524-0c7b-4fcb-8df6-3c0a131ece67 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "POST /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19/action" status: 202 len: 0 microversion: 2.1 time: 0.168418 Jun 16 17:24:44.730714 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 132/269] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jun 16 17:24:44 2022] POST /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:24:44.736176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-98c097ee-37ae-4e28-908a-ffd50c6d1d1c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:44.736997 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-98c097ee-37ae-4e28-908a-ffd50c6d1d1c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:44.752587 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-98c097ee-37ae-4e28-908a-ffd50c6d1d1c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:44.758768 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-98c097ee-37ae-4e28-908a-ffd50c6d1d1c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:44.759921 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-98c097ee-37ae-4e28-908a-ffd50c6d1d1c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:44.760358 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-98c097ee-37ae-4e28-908a-ffd50c6d1d1c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:45.079695 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d533687e-d60d-4d83-9fb6-edef2878da55 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:45.080396 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-d533687e-d60d-4d83-9fb6-edef2878da55 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:45.087769 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d533687e-d60d-4d83-9fb6-edef2878da55 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:45.088360 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d533687e-d60d-4d83-9fb6-edef2878da55 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:45.089261 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d533687e-d60d-4d83-9fb6-edef2878da55 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:45.089689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d533687e-d60d-4d83-9fb6-edef2878da55 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:45.207098 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-98c097ee-37ae-4e28-908a-ffd50c6d1d1c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:45.216563 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-98c097ee-37ae-4e28-908a-ffd50c6d1d1c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1509 microversion: 2.1 time: 0.485041 Jun 16 17:24:45.225356 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 138/270] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:44 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1509 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:24:45.287827 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d533687e-d60d-4d83-9fb6-edef2878da55 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:45.295850 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-d533687e-d60d-4d83-9fb6-edef2878da55 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1315 microversion: 2.1 time: 0.220488 Jun 16 17:24:45.296424 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 133/271] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:45 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:45.943681 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-970e0469-b6d7-46df-a16d-f58d12c440e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:45.944159 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-970e0469-b6d7-46df-a16d-f58d12c440e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:45.950526 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-970e0469-b6d7-46df-a16d-f58d12c440e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:45.950974 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-970e0469-b6d7-46df-a16d-f58d12c440e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:45.951729 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-970e0469-b6d7-46df-a16d-f58d12c440e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:45.952169 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-970e0469-b6d7-46df-a16d-f58d12c440e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:45.980153 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-970e0469-b6d7-46df-a16d-f58d12c440e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/ips" status: 200 len: 152 microversion: 2.20 time: 0.040483 Jun 16 17:24:45.980727 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 139/272] 10.222.0.66 () {60 vars in 1288 bytes} [Thu Jun 16 17:24:45 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:24:46.242258 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-1667409c-964f-4c15-8043-1e55ffa6ace1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:46.243397 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-1667409c-964f-4c15-8043-1e55ffa6ace1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:46.255085 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1667409c-964f-4c15-8043-1e55ffa6ace1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:46.255780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1667409c-964f-4c15-8043-1e55ffa6ace1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:46.257790 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1667409c-964f-4c15-8043-1e55ffa6ace1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:46.259076 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1667409c-964f-4c15-8043-1e55ffa6ace1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:46.321511 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-354afb08-8dfc-41fd-89f9-e87e907b38a9 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:46.326784 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-354afb08-8dfc-41fd-89f9-e87e907b38a9 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:46.333507 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:24:46.363694 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-354afb08-8dfc-41fd-89f9-e87e907b38a9 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:46.367893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-354afb08-8dfc-41fd-89f9-e87e907b38a9 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:46.369010 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-354afb08-8dfc-41fd-89f9-e87e907b38a9 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:46.369622 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-354afb08-8dfc-41fd-89f9-e87e907b38a9 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:46.541649 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-1667409c-964f-4c15-8043-1e55ffa6ace1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:46.550628 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-1667409c-964f-4c15-8043-1e55ffa6ace1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1509 microversion: 2.1 time: 0.316652 Jun 16 17:24:46.551199 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 134/273] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:46 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1509 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:46.558232 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-354afb08-8dfc-41fd-89f9-e87e907b38a9 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:46.565956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-354afb08-8dfc-41fd-89f9-e87e907b38a9 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1315 microversion: 2.1 time: 0.255561 Jun 16 17:24:46.566757 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 140/274] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:46 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:47.568949 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8bab16e5-c0fd-40c3-9c28-c4d973448a97 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:47.569586 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-8bab16e5-c0fd-40c3-9c28-c4d973448a97 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:47.577162 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8bab16e5-c0fd-40c3-9c28-c4d973448a97 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:47.577611 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8bab16e5-c0fd-40c3-9c28-c4d973448a97 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:47.578404 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8bab16e5-c0fd-40c3-9c28-c4d973448a97 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:47.578805 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8bab16e5-c0fd-40c3-9c28-c4d973448a97 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:47.586035 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9b95088e-5b36-45f4-90bc-3f6a1f50b9c3 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:47.586633 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-9b95088e-5b36-45f4-90bc-3f6a1f50b9c3 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:47.593287 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9b95088e-5b36-45f4-90bc-3f6a1f50b9c3 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:47.594012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9b95088e-5b36-45f4-90bc-3f6a1f50b9c3 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:47.595063 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9b95088e-5b36-45f4-90bc-3f6a1f50b9c3 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:47.595893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9b95088e-5b36-45f4-90bc-3f6a1f50b9c3 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:47.731989 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8bab16e5-c0fd-40c3-9c28-c4d973448a97 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:47.740702 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8bab16e5-c0fd-40c3-9c28-c4d973448a97 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1509 microversion: 2.1 time: 0.175742 Jun 16 17:24:47.741308 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 135/275] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:47 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:47.742120 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9b95088e-5b36-45f4-90bc-3f6a1f50b9c3 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:47.752756 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9b95088e-5b36-45f4-90bc-3f6a1f50b9c3 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1315 microversion: 2.1 time: 0.171501 Jun 16 17:24:47.753529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 141/276] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:47 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:24:48.082830 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a27f6023-0b66-48e7-9123-e469779c86c8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:48.083599 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a27f6023-0b66-48e7-9123-e469779c86c8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:48.093344 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a27f6023-0b66-48e7-9123-e469779c86c8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:48.093932 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a27f6023-0b66-48e7-9123-e469779c86c8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:48.094816 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a27f6023-0b66-48e7-9123-e469779c86c8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:48.095283 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a27f6023-0b66-48e7-9123-e469779c86c8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:48.124079 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.objects.instance [None req-a27f6023-0b66-48e7-9123-e469779c86c8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lazy-loading 'flavor' on Instance uuid ab2e7148-fa86-4648-9e4b-87e27fcf1147 {{(pid=117553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:24:48.463772 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a27f6023-0b66-48e7-9123-e469779c86c8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "POST /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/action" status: 202 len: 0 microversion: 2.20 time: 0.386355 Jun 16 17:24:48.464601 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 136/277] 10.222.0.66 () {62 vars in 1318 bytes} [Thu Jun 16 17:24:48 2022] POST /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:24:48.481511 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-618ec244-624b-470e-a3de-24a018f561c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:48.482113 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-618ec244-624b-470e-a3de-24a018f561c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:48.499183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-618ec244-624b-470e-a3de-24a018f561c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:48.500318 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-618ec244-624b-470e-a3de-24a018f561c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:48.500619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-618ec244-624b-470e-a3de-24a018f561c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:48.505625 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-618ec244-624b-470e-a3de-24a018f561c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:48.513275 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=100 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:24:48.676436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-618ec244-624b-470e-a3de-24a018f561c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:48.685253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-618ec244-624b-470e-a3de-24a018f561c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:48.686765 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-618ec244-624b-470e-a3de-24a018f561c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:48.687961 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-618ec244-624b-470e-a3de-24a018f561c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1721 microversion: 2.20 time: 0.211290 Jun 16 17:24:48.688534 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 142/278] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:24:48 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:24:48.763032 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-387a154c-60de-420c-bd9f-7088c2301602 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:48.764353 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-387a154c-60de-420c-bd9f-7088c2301602 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:48.771459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-16e558ec-e64c-474d-bb53-d95b737d19b9 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:48.772528 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-16e558ec-e64c-474d-bb53-d95b737d19b9 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:48.774252 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-387a154c-60de-420c-bd9f-7088c2301602 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:48.774948 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-387a154c-60de-420c-bd9f-7088c2301602 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:48.775910 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-387a154c-60de-420c-bd9f-7088c2301602 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:48.776346 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-387a154c-60de-420c-bd9f-7088c2301602 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:48.779691 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-16e558ec-e64c-474d-bb53-d95b737d19b9 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:48.780139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-16e558ec-e64c-474d-bb53-d95b737d19b9 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:48.781272 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-16e558ec-e64c-474d-bb53-d95b737d19b9 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:48.781986 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-16e558ec-e64c-474d-bb53-d95b737d19b9 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:48.973152 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-16e558ec-e64c-474d-bb53-d95b737d19b9 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:48.976861 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-387a154c-60de-420c-bd9f-7088c2301602 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:48.985251 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-16e558ec-e64c-474d-bb53-d95b737d19b9 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1464 microversion: 2.1 time: 0.218921 Jun 16 17:24:48.985832 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-387a154c-60de-420c-bd9f-7088c2301602 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1509 microversion: 2.1 time: 0.230325 Jun 16 17:24:48.986225 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 143/279] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:48 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1464 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:48.986767 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 137/280] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:48 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:49.035163 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d447fe60-c930-453e-b284-5bb6e1b945a6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:49.035617 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d447fe60-c930-453e-b284-5bb6e1b945a6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:49.043155 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d447fe60-c930-453e-b284-5bb6e1b945a6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:49.043754 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d447fe60-c930-453e-b284-5bb6e1b945a6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:49.044578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d447fe60-c930-453e-b284-5bb6e1b945a6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:49.045634 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d447fe60-c930-453e-b284-5bb6e1b945a6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:49.074280 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d447fe60-c930-453e-b284-5bb6e1b945a6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Going to try to terminate instance {{(pid=117552) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:24:49.185818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d447fe60-c930-453e-b284-5bb6e1b945a6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "DELETE /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 204 len: 0 microversion: 2.1 time: 0.155388 Jun 16 17:24:49.187124 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 144/281] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:24:49 2022] DELETE /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:24:49.197393 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b404ef48-4489-4312-9165-e38879bfa822 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:49.198015 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-b404ef48-4489-4312-9165-e38879bfa822 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:49.215322 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b404ef48-4489-4312-9165-e38879bfa822 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:49.216226 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b404ef48-4489-4312-9165-e38879bfa822 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:49.218012 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b404ef48-4489-4312-9165-e38879bfa822 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:49.218649 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b404ef48-4489-4312-9165-e38879bfa822 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:49.401210 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b404ef48-4489-4312-9165-e38879bfa822 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:49.410956 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b404ef48-4489-4312-9165-e38879bfa822 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1470 microversion: 2.1 time: 0.218102 Jun 16 17:24:49.412763 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 138/282] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:49 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1470 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:49.707124 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9d47036c-8915-425a-994c-687eb6245be1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:49.707856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-9d47036c-8915-425a-994c-687eb6245be1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:49.715454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9d47036c-8915-425a-994c-687eb6245be1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:49.716571 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9d47036c-8915-425a-994c-687eb6245be1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:49.717015 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9d47036c-8915-425a-994c-687eb6245be1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:49.717586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9d47036c-8915-425a-994c-687eb6245be1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:49.874499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9d47036c-8915-425a-994c-687eb6245be1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:49.883149 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9d47036c-8915-425a-994c-687eb6245be1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:49.884887 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9d47036c-8915-425a-994c-687eb6245be1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:49.886089 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9d47036c-8915-425a-994c-687eb6245be1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1721 microversion: 2.20 time: 0.183329 Jun 16 17:24:49.886638 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 145/283] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:24:49 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:24:50.005779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-9c449ed8-5063-48da-b58a-cae77f239170 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:50.006600 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-9c449ed8-5063-48da-b58a-cae77f239170 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:50.019495 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9c449ed8-5063-48da-b58a-cae77f239170 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:50.020273 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9c449ed8-5063-48da-b58a-cae77f239170 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:50.021384 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9c449ed8-5063-48da-b58a-cae77f239170 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:50.022045 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9c449ed8-5063-48da-b58a-cae77f239170 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:50.170170 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-9c449ed8-5063-48da-b58a-cae77f239170 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:50.178129 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-9c449ed8-5063-48da-b58a-cae77f239170 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1515 microversion: 2.1 time: 0.177766 Jun 16 17:24:50.178707 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 139/284] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:49 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:50.433946 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-089c1b19-a2d4-40af-9574-e2dd180dbfc6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:50.434829 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-089c1b19-a2d4-40af-9574-e2dd180dbfc6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:50.442204 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-089c1b19-a2d4-40af-9574-e2dd180dbfc6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:50.443104 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-089c1b19-a2d4-40af-9574-e2dd180dbfc6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:50.444431 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-089c1b19-a2d4-40af-9574-e2dd180dbfc6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:50.445405 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-089c1b19-a2d4-40af-9574-e2dd180dbfc6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:50.640048 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-089c1b19-a2d4-40af-9574-e2dd180dbfc6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:50.652182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-089c1b19-a2d4-40af-9574-e2dd180dbfc6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1470 microversion: 2.1 time: 0.223735 Jun 16 17:24:50.655264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 146/285] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:50 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1470 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:50.908047 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b6c81bcb-33d1-4ec7-b556-0dce68277fdc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:50.908998 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-b6c81bcb-33d1-4ec7-b556-0dce68277fdc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:50.918379 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b6c81bcb-33d1-4ec7-b556-0dce68277fdc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:50.918974 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b6c81bcb-33d1-4ec7-b556-0dce68277fdc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:50.920841 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b6c81bcb-33d1-4ec7-b556-0dce68277fdc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:50.922083 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b6c81bcb-33d1-4ec7-b556-0dce68277fdc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:51.149060 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b6c81bcb-33d1-4ec7-b556-0dce68277fdc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:51.158908 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b6c81bcb-33d1-4ec7-b556-0dce68277fdc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:51.160402 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b6c81bcb-33d1-4ec7-b556-0dce68277fdc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:51.161745 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b6c81bcb-33d1-4ec7-b556-0dce68277fdc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1721 microversion: 2.20 time: 0.259328 Jun 16 17:24:51.162444 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 140/286] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:24:50 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:24:51.275836 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7467093a-09ae-4c8c-9e29-1d3ac929106f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:51.277450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7467093a-09ae-4c8c-9e29-1d3ac929106f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:51.283455 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7467093a-09ae-4c8c-9e29-1d3ac929106f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:51.283895 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7467093a-09ae-4c8c-9e29-1d3ac929106f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:51.284677 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7467093a-09ae-4c8c-9e29-1d3ac929106f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:51.285103 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7467093a-09ae-4c8c-9e29-1d3ac929106f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:51.312995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7467093a-09ae-4c8c-9e29-1d3ac929106f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/ips" status: 200 len: 146 microversion: 2.1 time: 0.046901 Jun 16 17:24:51.313853 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 147/287] 10.222.0.66 () {58 vars in 1247 bytes} [Thu Jun 16 17:24:51 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/ips => generated 146 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:24:51.628524 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-96c45fce-35c8-4e08-81d0-618c42bd50fc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Action: 'create', calling method: .version_select at 0x7f66b1a0f550>, body: {"keypair": {"name": "tempest-keypair-255563373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhkZnHCT9LlSGFsn8/LSc45bOSmwyxg9q5SQJcf65f7VpNy1FSHf4AIiSeonq+2CHI098lno7ySQZtF54c7y0OZ7wYsgxKTTbG9Uxs5h+DKn6BI+FuLrfPJXRnodMqiag=="}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:51.657805 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-96c45fce-35c8-4e08-81d0-618c42bd50fc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Getting quotas for project ccf5c45783454fc5a7872490196f07e0. Resources: {'key_pairs'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:24:51.666922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-96c45fce-35c8-4e08-81d0-618c42bd50fc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Getting quotas for user 0cd8a309f6914d83b8e72bc60a5d7924 and project ccf5c45783454fc5a7872490196f07e0. Resources: {'key_pairs'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:24:51.672296 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5926aaf6-ed4e-4ffa-9e0b-045a462a7a78 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:51.673367 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-5926aaf6-ed4e-4ffa-9e0b-045a462a7a78 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:51.696901 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5926aaf6-ed4e-4ffa-9e0b-045a462a7a78 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:51.697996 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5926aaf6-ed4e-4ffa-9e0b-045a462a7a78 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:51.700342 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5926aaf6-ed4e-4ffa-9e0b-045a462a7a78 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:51.703879 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5926aaf6-ed4e-4ffa-9e0b-045a462a7a78 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:51.713262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-96c45fce-35c8-4e08-81d0-618c42bd50fc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.089057 Jun 16 17:24:51.715362 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 141/288] 10.222.0.66 () {60 vars in 1158 bytes} [Thu Jun 16 17:24:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:24:51.864419 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5926aaf6-ed4e-4ffa-9e0b-045a462a7a78 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4b12d5d8f647589a2226303b01c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d89beafb10246f7b9087ca7cd75f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:51.875351 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-5926aaf6-ed4e-4ffa-9e0b-045a462a7a78 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 200 len: 1428 microversion: 2.1 time: 0.208881 Jun 16 17:24:51.876046 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 148/289] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:51 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 1428 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:24:52.017014 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-422833cf-cc95-486e-b2e2-0c3da7344154 req-0f75d5f1-a2bc-4819-b266-2ddea2f57ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e2df49-edf7-4ed4-b8fe-bcc61f5d0807", "name": "network-vif-deleted", "tag": "2ba9ec91-2d6b-4395-ba81-e0d7dc6364ff"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:52.059343 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-422833cf-cc95-486e-b2e2-0c3da7344154 req-0f75d5f1-a2bc-4819-b266-2ddea2f57ab3 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:52.060307 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-422833cf-cc95-486e-b2e2-0c3da7344154 req-0f75d5f1-a2bc-4819-b266-2ddea2f57ab3 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:52.078335 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-422833cf-cc95-486e-b2e2-0c3da7344154 req-0f75d5f1-a2bc-4819-b266-2ddea2f57ab3 service nova] Creating event network-vif-deleted:2ba9ec91-2d6b-4395-ba81-e0d7dc6364ff for instance 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 on hv-cinder-83735 Jun 16 17:24:52.086439 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-422833cf-cc95-486e-b2e2-0c3da7344154 req-0f75d5f1-a2bc-4819-b266-2ddea2f57ab3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085344 Jun 16 17:24:52.088218 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 142/290] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:24:52.184585 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-fa111398-2745-429a-8f80-83a0414ec3cd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:52.185579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-fa111398-2745-429a-8f80-83a0414ec3cd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:52.193761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fa111398-2745-429a-8f80-83a0414ec3cd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:52.194789 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fa111398-2745-429a-8f80-83a0414ec3cd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:52.197032 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fa111398-2745-429a-8f80-83a0414ec3cd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:52.197786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fa111398-2745-429a-8f80-83a0414ec3cd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:52.410613 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-fa111398-2745-429a-8f80-83a0414ec3cd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:52.428622 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-fa111398-2745-429a-8f80-83a0414ec3cd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:52.431779 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-fa111398-2745-429a-8f80-83a0414ec3cd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:52.433971 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-fa111398-2745-429a-8f80-83a0414ec3cd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1721 microversion: 2.20 time: 0.255714 Jun 16 17:24:52.434954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 149/291] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:24:52 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:24:52.899588 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-13dacda0-fc96-463f-b5d6-b4006fee2ad6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:52.901802 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-13dacda0-fc96-463f-b5d6-b4006fee2ad6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] [instance: 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:52.908119 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-13dacda0-fc96-463f-b5d6-b4006fee2ad6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:52.908875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-13dacda0-fc96-463f-b5d6-b4006fee2ad6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:52.909943 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-13dacda0-fc96-463f-b5d6-b4006fee2ad6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:52.910577 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-13dacda0-fc96-463f-b5d6-b4006fee2ad6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:52.938781 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-13dacda0-fc96-463f-b5d6-b4006fee2ad6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] HTTP exception thrown: Instance 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 could not be found. Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-13dacda0-fc96-463f-b5d6-b4006fee2ad6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Request method failure captured: Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 HTTP/1.1 Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2dFXQ6JkRTOxQjc-R9n-puttgQoI7QlU8L9Crcis5aQ0PUKJZXT0wLOcTKJoMHBc88Eau_wydE3p0uy3VRrBQaOYUSosnBUNYnrH-Om20H5NBshD3Xb1U-qY2Gbjk1sTbDDsEO3VJa1zSwm4Cd0DjUu5qXtZyF0yQGJceJpAns4JIo Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: 9d89beafb10246f7b9087ca7cd75f239 Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-VolumesNegativeTest-1312001125 Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:24:52.940699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:24:52.942295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9d89beafb10246f7b9087ca7cd75f239"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9d89beafb10246f7b9087ca7cd75f239"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9d89beafb10246f7b9087ca7cd75f239", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9d89beafb10246f7b9087ca7cd75f239"}]}] Jun 16 17:24:52.942295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-VolumesNegativeTest-1312001125 Jun 16 17:24:52.942295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: 9d89beafb10246f7b9087ca7cd75f239 Jun 16 17:24:52.942295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-VolumesNegativeTest-1312001125 Jun 16 17:24:52.942295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-VolumesNegativeTest-1312001125-project Jun 16 17:24:52.942295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:24:52.942295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:24:52.942295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: da4b12d5d8f647589a2226303b01c2f3 Jun 16 17:24:52.942295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-VolumesNegativeTest-1312001125-project Jun 16 17:24:52.942295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:24:52.942295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 could not be found. Jun 16 17:24:52.942295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': '65e2df49-edf7-4ed4-b8fe-bcc61f5d0807'} Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 could not be found. Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:24:52.943276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 could not be found. Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 could not be found. Jun 16 17:24:52.944420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:24:52.948717 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-13dacda0-fc96-463f-b5d6-b4006fee2ad6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] Returning 404 to user: Instance 65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:24:52.948717 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-13dacda0-fc96-463f-b5d6-b4006fee2ad6 tempest-VolumesNegativeTest-1312001125 tempest-VolumesNegativeTest-1312001125-project] 10.222.0.66 "GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807" status: 404 len: 111 microversion: 2.1 time: 0.050025 Jun 16 17:24:52.948717 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 143/292] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:52 2022] GET /compute/v2.1/servers/65e2df49-edf7-4ed4-b8fe-bcc61f5d0807 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:24:53.462827 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-3a6bc24b-b4aa-4052-8ddd-7af40af38524 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:53.464856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-3a6bc24b-b4aa-4052-8ddd-7af40af38524 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:53.473695 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3a6bc24b-b4aa-4052-8ddd-7af40af38524 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:53.474278 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3a6bc24b-b4aa-4052-8ddd-7af40af38524 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:53.475609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3a6bc24b-b4aa-4052-8ddd-7af40af38524 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:53.477150 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3a6bc24b-b4aa-4052-8ddd-7af40af38524 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:53.805038 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-3a6bc24b-b4aa-4052-8ddd-7af40af38524 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:53.819064 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-3a6bc24b-b4aa-4052-8ddd-7af40af38524 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:53.823049 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-3a6bc24b-b4aa-4052-8ddd-7af40af38524 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:53.825260 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-3a6bc24b-b4aa-4052-8ddd-7af40af38524 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1721 microversion: 2.20 time: 0.368936 Jun 16 17:24:53.827353 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 150/293] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:24:53 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1721 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:24:54.302644 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-0d33fdc9-8c57-4166-9927-4f96f0b3724d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-68597070", "imageRef": "c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7c13538c-2941-4763-a560-37a0a33d14c7"}], "security_groups": [{"name": "tempest-securitygroup--1189834984"}], "key_name": "tempest-keypair-255563373", "user_data": "}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:54.436786 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.network.neutron [None req-0d33fdc9-8c57-4166-9927-4f96f0b3724d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] validate_networks() for [('7c13538c-2941-4763-a560-37a0a33d14c7', None, None, None, None, None)] {{(pid=117553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:24:54.804927 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-bdb9339e-d7f7-46e4-8874-e88b0ecbcee7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-46234033", "imageRef": "c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1", "flavorRef": "452", "networks": [{"uuid": "184a3d80-6b15-43ef-84b8-ddb86570078c"}]}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:54.941852 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.network.neutron [None req-bdb9339e-d7f7-46e4-8874-e88b0ecbcee7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] validate_networks() for [('184a3d80-6b15-43ef-84b8-ddb86570078c', None, None, None, None, None)] {{(pid=117552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:24:54.989975 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-0d33fdc9-8c57-4166-9927-4f96f0b3724d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Flavor limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:24:54.990713 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-0d33fdc9-8c57-4166-9927-4f96f0b3724d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Image limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:24:54.997360 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-0d33fdc9-8c57-4166-9927-4f96f0b3724d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Flavor pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:24:54.997833 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-0d33fdc9-8c57-4166-9927-4f96f0b3724d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Image pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:24:55.000122 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-0d33fdc9-8c57-4166-9927-4f96f0b3724d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:24:55.016093 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0d33fdc9-8c57-4166-9927-4f96f0b3724d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:55.016578 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0d33fdc9-8c57-4166-9927-4f96f0b3724d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:55.018100 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0d33fdc9-8c57-4166-9927-4f96f0b3724d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:55.018611 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0d33fdc9-8c57-4166-9927-4f96f0b3724d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:55.041061 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-0d33fdc9-8c57-4166-9927-4f96f0b3724d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Getting quotas for project ccf5c45783454fc5a7872490196f07e0. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:24:55.048097 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-0d33fdc9-8c57-4166-9927-4f96f0b3724d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Getting quotas for user 0cd8a309f6914d83b8e72bc60a5d7924 and project ccf5c45783454fc5a7872490196f07e0. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:24:55.078506 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-0d33fdc9-8c57-4166-9927-4f96f0b3724d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Going to run 1 instances... {{(pid=117553) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:24:55.083069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-0d33fdc9-8c57-4166-9927-4f96f0b3724d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:24:55.165363 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-0d33fdc9-8c57-4166-9927-4f96f0b3724d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.865777 Jun 16 17:24:55.166262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 144/294] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:24:54 2022] POST /compute/v2.1/servers => generated 409 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:24:55.175317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b88a347e-e0ce-44d3-8c12-6432062a668c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:55.176355 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-b88a347e-e0ce-44d3-8c12-6432062a668c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:55.188784 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b88a347e-e0ce-44d3-8c12-6432062a668c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:55.189599 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b88a347e-e0ce-44d3-8c12-6432062a668c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:55.190916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b88a347e-e0ce-44d3-8c12-6432062a668c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:55.191616 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b88a347e-e0ce-44d3-8c12-6432062a668c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:55.471193 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b88a347e-e0ce-44d3-8c12-6432062a668c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:55.484595 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b88a347e-e0ce-44d3-8c12-6432062a668c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:55.496213 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b88a347e-e0ce-44d3-8c12-6432062a668c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:55.497582 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b88a347e-e0ce-44d3-8c12-6432062a668c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1721 microversion: 2.20 time: 0.329802 Jun 16 17:24:55.509340 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 145/295] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:24:55 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1721 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:24:55.514275 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c43e2221-c0e9-4772-b962-a56dbe32b07b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:55.515060 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c43e2221-c0e9-4772-b962-a56dbe32b07b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:55.581108 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c43e2221-c0e9-4772-b962-a56dbe32b07b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:55.590470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c43e2221-c0e9-4772-b962-a56dbe32b07b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1243 microversion: 2.1 time: 0.079928 Jun 16 17:24:55.591068 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 146/296] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:55 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1243 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:55.597895 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f603f897-7101-4253-b383-f26c4770793a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "012b766a-7d34-46be-a811-430fe788ce04"}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:55.599308 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f603f897-7101-4253-b383-f26c4770793a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:55.614136 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f603f897-7101-4253-b383-f26c4770793a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:55.614580 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f603f897-7101-4253-b383-f26c4770793a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:55.615361 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f603f897-7101-4253-b383-f26c4770793a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:55.615905 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f603f897-7101-4253-b383-f26c4770793a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:55.861285 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-bdb9339e-d7f7-46e4-8874-e88b0ecbcee7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Flavor limits 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:24:55.862734 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-bdb9339e-d7f7-46e4-8874-e88b0ecbcee7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Image limits 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:24:55.863412 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-bdb9339e-d7f7-46e4-8874-e88b0ecbcee7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Flavor pref 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:24:55.864075 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-bdb9339e-d7f7-46e4-8874-e88b0ecbcee7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Image pref 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:24:55.864904 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-bdb9339e-d7f7-46e4-8874-e88b0ecbcee7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:24:55.888725 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bdb9339e-d7f7-46e4-8874-e88b0ecbcee7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:55.889690 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bdb9339e-d7f7-46e4-8874-e88b0ecbcee7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:55.891071 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bdb9339e-d7f7-46e4-8874-e88b0ecbcee7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:55.891902 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bdb9339e-d7f7-46e4-8874-e88b0ecbcee7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:55.917242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-bdb9339e-d7f7-46e4-8874-e88b0ecbcee7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Getting quotas for project f96239e8e212410aac9df2d35293c665. Resources: {'cores', 'instances', 'ram'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:24:55.922081 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-bdb9339e-d7f7-46e4-8874-e88b0ecbcee7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Getting quotas for user 8b088ae5ce5046ae83d9ae151dc52eca and project f96239e8e212410aac9df2d35293c665. Resources: {'cores', 'instances', 'ram'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:24:55.936603 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-bdb9339e-d7f7-46e4-8874-e88b0ecbcee7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Going to run 1 instances... {{(pid=117552) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:24:55.939729 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-bdb9339e-d7f7-46e4-8874-e88b0ecbcee7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:24:55.974017 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f603f897-7101-4253-b383-f26c4770793a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "POST /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379329 Jun 16 17:24:55.980602 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 147/297] 10.222.0.66 () {60 vars in 1322 bytes} [Thu Jun 16 17:24:55 2022] POST /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/os-volume_attachments => generated 194 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:24:56.041081 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-bdb9339e-d7f7-46e4-8874-e88b0ecbcee7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.240556 Jun 16 17:24:56.047341 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 151/298] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:24:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:24:56.054196 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d22e6c71-9cee-40f9-be34-d302d1b5b41d tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:56.064899 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-d22e6c71-9cee-40f9-be34-d302d1b5b41d tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:56.168726 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d22e6c71-9cee-40f9-be34-d302d1b5b41d tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:56.189320 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-d22e6c71-9cee-40f9-be34-d302d1b5b41d tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 200 len: 1217 microversion: 2.1 time: 0.140030 Jun 16 17:24:56.189967 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 148/299] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:56 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 1217 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:56.518785 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-dfffee3c-a2fe-453a-aaa1-68ff7d1f1fb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:56.520477 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-dfffee3c-a2fe-453a-aaa1-68ff7d1f1fb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:56.531489 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-dfffee3c-a2fe-453a-aaa1-68ff7d1f1fb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:56.532816 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-dfffee3c-a2fe-453a-aaa1-68ff7d1f1fb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:56.533875 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-dfffee3c-a2fe-453a-aaa1-68ff7d1f1fb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:56.534658 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-dfffee3c-a2fe-453a-aaa1-68ff7d1f1fb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:56.608784 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-29402523-0304-4888-ac74-d4693ffe46f6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:56.609607 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-29402523-0304-4888-ac74-d4693ffe46f6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:56.635165 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-29402523-0304-4888-ac74-d4693ffe46f6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:56.638279 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-29402523-0304-4888-ac74-d4693ffe46f6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:56.639339 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-29402523-0304-4888-ac74-d4693ffe46f6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:56.643176 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-29402523-0304-4888-ac74-d4693ffe46f6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:56.745914 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-29402523-0304-4888-ac74-d4693ffe46f6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:56.758502 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-29402523-0304-4888-ac74-d4693ffe46f6 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1303 microversion: 2.1 time: 0.154189 Jun 16 17:24:56.760165 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 149/300] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:56 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1303 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:56.872104 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-dfffee3c-a2fe-453a-aaa1-68ff7d1f1fb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:56.888122 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-dfffee3c-a2fe-453a-aaa1-68ff7d1f1fb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:56.904711 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-dfffee3c-a2fe-453a-aaa1-68ff7d1f1fb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:56.906353 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-dfffee3c-a2fe-453a-aaa1-68ff7d1f1fb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1721 microversion: 2.20 time: 0.392714 Jun 16 17:24:56.908444 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 152/301] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:24:56 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1721 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:24:57.208248 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5743e9dd-e2fb-433a-9517-be9170b52d19 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:57.208884 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5743e9dd-e2fb-433a-9517-be9170b52d19 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:57.217016 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5743e9dd-e2fb-433a-9517-be9170b52d19 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:57.217485 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5743e9dd-e2fb-433a-9517-be9170b52d19 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:57.221968 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5743e9dd-e2fb-433a-9517-be9170b52d19 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:57.225023 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5743e9dd-e2fb-433a-9517-be9170b52d19 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:57.306870 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-5743e9dd-e2fb-433a-9517-be9170b52d19 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:57.317397 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5743e9dd-e2fb-433a-9517-be9170b52d19 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 200 len: 1213 microversion: 2.1 time: 0.113708 Jun 16 17:24:57.318495 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 150/302] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:57 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 1213 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:57.779699 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-49dd93c1-6653-47c3-897c-7fc7c32746be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:57.780414 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-49dd93c1-6653-47c3-897c-7fc7c32746be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:57.787199 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-49dd93c1-6653-47c3-897c-7fc7c32746be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:57.787722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-49dd93c1-6653-47c3-897c-7fc7c32746be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:57.788619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-49dd93c1-6653-47c3-897c-7fc7c32746be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:57.789402 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-49dd93c1-6653-47c3-897c-7fc7c32746be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:57.938322 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f8e636ec-cd97-49bd-a2fa-12dd09701a9b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:57.941597 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f8e636ec-cd97-49bd-a2fa-12dd09701a9b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:57.954335 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f8e636ec-cd97-49bd-a2fa-12dd09701a9b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:57.954986 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f8e636ec-cd97-49bd-a2fa-12dd09701a9b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:57.956167 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f8e636ec-cd97-49bd-a2fa-12dd09701a9b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:57.956602 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f8e636ec-cd97-49bd-a2fa-12dd09701a9b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:58.112772 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-f8e636ec-cd97-49bd-a2fa-12dd09701a9b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:58.122654 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-f8e636ec-cd97-49bd-a2fa-12dd09701a9b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:58.124962 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-f8e636ec-cd97-49bd-a2fa-12dd09701a9b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:58.126353 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f8e636ec-cd97-49bd-a2fa-12dd09701a9b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1721 microversion: 2.20 time: 0.200499 Jun 16 17:24:58.127436 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 151/303] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:24:57 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:24:58.131931 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-49dd93c1-6653-47c3-897c-7fc7c32746be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:58.142435 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-49dd93c1-6653-47c3-897c-7fc7c32746be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1369 microversion: 2.1 time: 0.369384 Jun 16 17:24:58.143018 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 153/304] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:57 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1369 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:58.343521 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-03dd70fa-f2d5-4892-a1e1-cd84bc23de99 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:58.345991 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-03dd70fa-f2d5-4892-a1e1-cd84bc23de99 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:58.352052 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:24:58.361385 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-03dd70fa-f2d5-4892-a1e1-cd84bc23de99 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:58.362234 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-03dd70fa-f2d5-4892-a1e1-cd84bc23de99 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:58.363436 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-03dd70fa-f2d5-4892-a1e1-cd84bc23de99 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:58.364147 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-03dd70fa-f2d5-4892-a1e1-cd84bc23de99 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:58.513312 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-03dd70fa-f2d5-4892-a1e1-cd84bc23de99 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:58.515442 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:24:58.524377 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-03dd70fa-f2d5-4892-a1e1-cd84bc23de99 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 200 len: 1275 microversion: 2.1 time: 0.190474 Jun 16 17:24:58.534759 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 152/305] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:58 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:59.004624 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-d423174c-b59d-4d74-9ad8-8a5ca56589a7 req-74419fbd-913c-40b0-a3d4-6e75ff3cddab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4065d5c1-0b16-413a-a5b5-e0e725e1e71b", "tag": "3e68f997-7180-47a9-a1f0-ae3a5f70d0a3"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:24:59.024858 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-d423174c-b59d-4d74-9ad8-8a5ca56589a7 req-74419fbd-913c-40b0-a3d4-6e75ff3cddab service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:59.025654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-d423174c-b59d-4d74-9ad8-8a5ca56589a7 req-74419fbd-913c-40b0-a3d4-6e75ff3cddab service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:59.059697 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-d423174c-b59d-4d74-9ad8-8a5ca56589a7 req-74419fbd-913c-40b0-a3d4-6e75ff3cddab service nova] Creating event network-changed:3e68f997-7180-47a9-a1f0-ae3a5f70d0a3 for instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b on hv-cinder-83735 Jun 16 17:24:59.070509 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-d423174c-b59d-4d74-9ad8-8a5ca56589a7 req-74419fbd-913c-40b0-a3d4-6e75ff3cddab service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069935 Jun 16 17:24:59.072538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 154/306] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:24:59.160808 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-795ca996-de76-48aa-89b2-135d26703aae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:59.160808 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-795ca996-de76-48aa-89b2-135d26703aae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:59.163470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-795ca996-de76-48aa-89b2-135d26703aae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:59.164058 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-795ca996-de76-48aa-89b2-135d26703aae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:59.165509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-795ca996-de76-48aa-89b2-135d26703aae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:59.165977 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-795ca996-de76-48aa-89b2-135d26703aae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:59.168561 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8ceb8057-0d62-4e3f-8e14-baeeadda9d06 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:59.169299 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8ceb8057-0d62-4e3f-8e14-baeeadda9d06 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:59.186827 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ceb8057-0d62-4e3f-8e14-baeeadda9d06 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:59.187583 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ceb8057-0d62-4e3f-8e14-baeeadda9d06 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:59.188536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ceb8057-0d62-4e3f-8e14-baeeadda9d06 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:59.189155 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ceb8057-0d62-4e3f-8e14-baeeadda9d06 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:59.375228 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-795ca996-de76-48aa-89b2-135d26703aae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:59.387005 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-795ca996-de76-48aa-89b2-135d26703aae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:59.390247 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-795ca996-de76-48aa-89b2-135d26703aae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:59.392378 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-795ca996-de76-48aa-89b2-135d26703aae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1721 microversion: 2.20 time: 0.244570 Jun 16 17:24:59.393580 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 153/307] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:24:59 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:24:59.543206 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-28833d29-3eba-49d8-9a17-14c418e8f6e4 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:24:59.544142 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-28833d29-3eba-49d8-9a17-14c418e8f6e4 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:24:59.553034 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-28833d29-3eba-49d8-9a17-14c418e8f6e4 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:59.553920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-28833d29-3eba-49d8-9a17-14c418e8f6e4 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:59.555061 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-28833d29-3eba-49d8-9a17-14c418e8f6e4 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:24:59.555722 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-28833d29-3eba-49d8-9a17-14c418e8f6e4 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:24:59.654508 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-28833d29-3eba-49d8-9a17-14c418e8f6e4 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:59.666339 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-28833d29-3eba-49d8-9a17-14c418e8f6e4 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 200 len: 1275 microversion: 2.1 time: 0.127661 Jun 16 17:24:59.667129 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 154/308] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:59 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 1275 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:24:59.677813 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8ceb8057-0d62-4e3f-8e14-baeeadda9d06 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:24:59.688220 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8ceb8057-0d62-4e3f-8e14-baeeadda9d06 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1369 microversion: 2.1 time: 0.525653 Jun 16 17:24:59.689486 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 155/309] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:24:59 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1369 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:00.413530 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-95bda6ad-6bc1-4722-9e9c-867209060113 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:00.414880 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-95bda6ad-6bc1-4722-9e9c-867209060113 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:00.423467 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-95bda6ad-6bc1-4722-9e9c-867209060113 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:00.424029 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-95bda6ad-6bc1-4722-9e9c-867209060113 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:00.424906 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-95bda6ad-6bc1-4722-9e9c-867209060113 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:00.425440 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-95bda6ad-6bc1-4722-9e9c-867209060113 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:00.604108 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-95bda6ad-6bc1-4722-9e9c-867209060113 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:00.612887 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-95bda6ad-6bc1-4722-9e9c-867209060113 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:00.614403 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-95bda6ad-6bc1-4722-9e9c-867209060113 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:00.615650 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-95bda6ad-6bc1-4722-9e9c-867209060113 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1721 microversion: 2.20 time: 0.207934 Jun 16 17:25:00.616201 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 155/310] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:00 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:00.684446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-3186c44f-8d80-4d98-885d-235c122994ad tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:00.685235 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-3186c44f-8d80-4d98-885d-235c122994ad tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:00.692202 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3186c44f-8d80-4d98-885d-235c122994ad tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:00.692638 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3186c44f-8d80-4d98-885d-235c122994ad tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:00.693462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3186c44f-8d80-4d98-885d-235c122994ad tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:00.693882 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3186c44f-8d80-4d98-885d-235c122994ad tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:00.711922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5ad92018-accd-48fa-ae3f-24367bfed8ed tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:00.712897 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5ad92018-accd-48fa-ae3f-24367bfed8ed tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:00.720172 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5ad92018-accd-48fa-ae3f-24367bfed8ed tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:00.720731 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5ad92018-accd-48fa-ae3f-24367bfed8ed tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:00.721567 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5ad92018-accd-48fa-ae3f-24367bfed8ed tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:00.722234 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5ad92018-accd-48fa-ae3f-24367bfed8ed tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:00.878454 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-5ad92018-accd-48fa-ae3f-24367bfed8ed tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:00.887188 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5ad92018-accd-48fa-ae3f-24367bfed8ed tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1369 microversion: 2.1 time: 0.179712 Jun 16 17:25:00.887806 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 156/311] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:00 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1369 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:01.362088 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-3186c44f-8d80-4d98-885d-235c122994ad tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:01.371209 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-3186c44f-8d80-4d98-885d-235c122994ad tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 200 len: 1317 microversion: 2.1 time: 0.690972 Jun 16 17:25:01.376009 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 156/312] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:00 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 1317 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:01.641136 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-e40685a9-6dbf-4db4-8e60-5f3e3252d2dc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:01.642127 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-e40685a9-6dbf-4db4-8e60-5f3e3252d2dc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:01.678347 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e40685a9-6dbf-4db4-8e60-5f3e3252d2dc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:01.682819 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e40685a9-6dbf-4db4-8e60-5f3e3252d2dc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:01.684251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e40685a9-6dbf-4db4-8e60-5f3e3252d2dc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:01.685437 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e40685a9-6dbf-4db4-8e60-5f3e3252d2dc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:01.707636 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-eee44d58-b28a-47ad-9d64-d38f22ad4f85 req-b25cb87d-da74-402f-bef7-1819b35f3443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e36f5bc-922d-4dfe-9ecb-49ba6c855878", "tag": "9e73391a-9d05-40e7-8c63-8913ccd9e1bc"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:25:01.742264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-eee44d58-b28a-47ad-9d64-d38f22ad4f85 req-b25cb87d-da74-402f-bef7-1819b35f3443 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:01.745770 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-eee44d58-b28a-47ad-9d64-d38f22ad4f85 req-b25cb87d-da74-402f-bef7-1819b35f3443 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:01.768118 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-eee44d58-b28a-47ad-9d64-d38f22ad4f85 req-b25cb87d-da74-402f-bef7-1819b35f3443 service nova] Creating event network-changed:9e73391a-9d05-40e7-8c63-8913ccd9e1bc for instance 0e36f5bc-922d-4dfe-9ecb-49ba6c855878 on hv-cinder-83735 Jun 16 17:25:01.773676 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-eee44d58-b28a-47ad-9d64-d38f22ad4f85 req-b25cb87d-da74-402f-bef7-1819b35f3443 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071874 Jun 16 17:25:01.774811 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 157/313] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:25:01.935635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-583f9f0c-9e5a-4109-8648-c7ab72cb0228 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:01.939701 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-583f9f0c-9e5a-4109-8648-c7ab72cb0228 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:01.952990 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-583f9f0c-9e5a-4109-8648-c7ab72cb0228 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:01.953910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-583f9f0c-9e5a-4109-8648-c7ab72cb0228 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:01.955148 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-583f9f0c-9e5a-4109-8648-c7ab72cb0228 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:01.955825 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-583f9f0c-9e5a-4109-8648-c7ab72cb0228 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:02.002069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e40685a9-6dbf-4db4-8e60-5f3e3252d2dc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:02.011234 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e40685a9-6dbf-4db4-8e60-5f3e3252d2dc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:02.012875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e40685a9-6dbf-4db4-8e60-5f3e3252d2dc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:02.014190 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-e40685a9-6dbf-4db4-8e60-5f3e3252d2dc tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1721 microversion: 2.20 time: 0.381793 Jun 16 17:25:02.014971 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 157/314] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:01 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1721 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:02.252157 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-583f9f0c-9e5a-4109-8648-c7ab72cb0228 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:02.267420 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-583f9f0c-9e5a-4109-8648-c7ab72cb0228 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1369 microversion: 2.1 time: 0.350993 Jun 16 17:25:02.269385 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 158/315] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:01 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1369 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:02.392545 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8e49e0d1-d041-41da-9f6e-8298e26cef74 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:02.393912 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-8e49e0d1-d041-41da-9f6e-8298e26cef74 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:02.401138 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8e49e0d1-d041-41da-9f6e-8298e26cef74 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:02.401694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8e49e0d1-d041-41da-9f6e-8298e26cef74 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:02.402757 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8e49e0d1-d041-41da-9f6e-8298e26cef74 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:02.403244 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8e49e0d1-d041-41da-9f6e-8298e26cef74 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:02.879798 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8e49e0d1-d041-41da-9f6e-8298e26cef74 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:02.927809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8e49e0d1-d041-41da-9f6e-8298e26cef74 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 200 len: 1317 microversion: 2.1 time: 0.539602 Jun 16 17:25:02.928417 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 158/316] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:02 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:03.036846 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-1a8791f6-1b0c-44ad-a232-81f86b844aa5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:03.038406 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-1a8791f6-1b0c-44ad-a232-81f86b844aa5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:03.050699 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1a8791f6-1b0c-44ad-a232-81f86b844aa5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:03.053526 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1a8791f6-1b0c-44ad-a232-81f86b844aa5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:03.057835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1a8791f6-1b0c-44ad-a232-81f86b844aa5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:03.061043 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1a8791f6-1b0c-44ad-a232-81f86b844aa5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:03.114807 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:03.285994 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-159ffeba-357b-4985-8424-36dc54f79919 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:03.286602 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-159ffeba-357b-4985-8424-36dc54f79919 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:03.296749 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-159ffeba-357b-4985-8424-36dc54f79919 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:03.298197 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-159ffeba-357b-4985-8424-36dc54f79919 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:03.299278 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-159ffeba-357b-4985-8424-36dc54f79919 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:03.299861 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-159ffeba-357b-4985-8424-36dc54f79919 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:03.375788 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-1a8791f6-1b0c-44ad-a232-81f86b844aa5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:03.385145 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-1a8791f6-1b0c-44ad-a232-81f86b844aa5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:03.386958 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-1a8791f6-1b0c-44ad-a232-81f86b844aa5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:03.388127 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-1a8791f6-1b0c-44ad-a232-81f86b844aa5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1721 microversion: 2.20 time: 0.359713 Jun 16 17:25:03.388701 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 159/317] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:03 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1721 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:03.630573 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-159ffeba-357b-4985-8424-36dc54f79919 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:03.645279 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-159ffeba-357b-4985-8424-36dc54f79919 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1369 microversion: 2.1 time: 0.362730 Jun 16 17:25:03.646014 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 159/318] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:03 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1369 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:03.795912 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-1e77a66e-c08f-4031-92ab-0c7f87ea54ec tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:25:03.803578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1e77a66e-c08f-4031-92ab-0c7f87ea54ec tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:03.804727 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1e77a66e-c08f-4031-92ab-0c7f87ea54ec tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:03.896414 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-1e77a66e-c08f-4031-92ab-0c7f87ea54ec tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Going to try to stop instance {{(pid=117552) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 17:25:03.950573 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a60d80a1-65ec-4fc9-9134-4092f2816a9c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:03.951498 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a60d80a1-65ec-4fc9-9134-4092f2816a9c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:03.968039 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a60d80a1-65ec-4fc9-9134-4092f2816a9c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:03.968711 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a60d80a1-65ec-4fc9-9134-4092f2816a9c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:03.969754 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a60d80a1-65ec-4fc9-9134-4092f2816a9c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:03.970338 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a60d80a1-65ec-4fc9-9134-4092f2816a9c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:03.982156 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-1e77a66e-c08f-4031-92ab-0c7f87ea54ec tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "POST /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/action" status: 202 len: 0 microversion: 2.1 time: 0.193927 Jun 16 17:25:03.983758 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 160/319] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jun 16 17:25:03 2022] POST /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:25:03.996974 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e527cf1e-4860-4b3f-a759-5c76ce02a4f8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:03.998029 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e527cf1e-4860-4b3f-a759-5c76ce02a4f8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:04.010218 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e527cf1e-4860-4b3f-a759-5c76ce02a4f8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:04.011129 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e527cf1e-4860-4b3f-a759-5c76ce02a4f8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:04.012313 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e527cf1e-4860-4b3f-a759-5c76ce02a4f8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:04.013012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e527cf1e-4860-4b3f-a759-5c76ce02a4f8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:04.210043 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-e527cf1e-4860-4b3f-a759-5c76ce02a4f8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:04.223746 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-e527cf1e-4860-4b3f-a759-5c76ce02a4f8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1723 microversion: 2.1 time: 0.234584 Jun 16 17:25:04.224335 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 161/320] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:03 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:04.283171 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a60d80a1-65ec-4fc9-9134-4092f2816a9c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:04.293160 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a60d80a1-65ec-4fc9-9134-4092f2816a9c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 200 len: 1317 microversion: 2.1 time: 0.348205 Jun 16 17:25:04.301643 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 160/321] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:03 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:04.411419 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f10fb1bc-f074-47dd-b0e9-f924bbe9ce93 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:04.412347 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f10fb1bc-f074-47dd-b0e9-f924bbe9ce93 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:04.430484 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f10fb1bc-f074-47dd-b0e9-f924bbe9ce93 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:04.431198 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f10fb1bc-f074-47dd-b0e9-f924bbe9ce93 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:04.432167 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f10fb1bc-f074-47dd-b0e9-f924bbe9ce93 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:04.432694 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f10fb1bc-f074-47dd-b0e9-f924bbe9ce93 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:04.665431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-20940533-ea8d-4330-b8e8-c1efc79e9e83 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:04.666102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-20940533-ea8d-4330-b8e8-c1efc79e9e83 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:04.679523 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-20940533-ea8d-4330-b8e8-c1efc79e9e83 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:04.680025 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-20940533-ea8d-4330-b8e8-c1efc79e9e83 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:04.681767 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-20940533-ea8d-4330-b8e8-c1efc79e9e83 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:04.682429 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-20940533-ea8d-4330-b8e8-c1efc79e9e83 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:04.843497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f10fb1bc-f074-47dd-b0e9-f924bbe9ce93 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:04.856908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f10fb1bc-f074-47dd-b0e9-f924bbe9ce93 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:04.879372 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f10fb1bc-f074-47dd-b0e9-f924bbe9ce93 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:04.881877 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f10fb1bc-f074-47dd-b0e9-f924bbe9ce93 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1721 microversion: 2.20 time: 0.477812 Jun 16 17:25:04.883057 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 162/322] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:04 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1721 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:05.000895 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-20940533-ea8d-4330-b8e8-c1efc79e9e83 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:05.015159 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-20940533-ea8d-4330-b8e8-c1efc79e9e83 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1369 microversion: 2.1 time: 0.355121 Jun 16 17:25:05.017285 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 161/323] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:04 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1369 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:25:05.248908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0d23cd69-809e-4abd-a70e-f9f4d6c5d6e0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:05.249557 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0d23cd69-809e-4abd-a70e-f9f4d6c5d6e0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:05.265471 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d23cd69-809e-4abd-a70e-f9f4d6c5d6e0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:05.267535 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d23cd69-809e-4abd-a70e-f9f4d6c5d6e0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:05.272252 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d23cd69-809e-4abd-a70e-f9f4d6c5d6e0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:05.272825 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d23cd69-809e-4abd-a70e-f9f4d6c5d6e0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:05.315681 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b5096926-5383-42ed-995e-858f33443591 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:05.316806 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-b5096926-5383-42ed-995e-858f33443591 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:05.321093 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:05.329246 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b5096926-5383-42ed-995e-858f33443591 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:05.330138 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b5096926-5383-42ed-995e-858f33443591 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:05.331587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b5096926-5383-42ed-995e-858f33443591 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:05.332193 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b5096926-5383-42ed-995e-858f33443591 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:05.568963 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0d23cd69-809e-4abd-a70e-f9f4d6c5d6e0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:05.580481 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0d23cd69-809e-4abd-a70e-f9f4d6c5d6e0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1723 microversion: 2.1 time: 0.335917 Jun 16 17:25:05.596494 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 163/324] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:05 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1723 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:05.602649 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-0ace1c42-bc39-4269-b732-7df3d0bac3f5 req-3069bfa7-2ce3-4059-a0fd-471e45e94118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4065d5c1-0b16-413a-a5b5-e0e725e1e71b", "name": "network-vif-plugged", "status": "completed", "tag": "3e68f997-7180-47a9-a1f0-ae3a5f70d0a3"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:25:05.612888 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-0ace1c42-bc39-4269-b732-7df3d0bac3f5 req-3069bfa7-2ce3-4059-a0fd-471e45e94118 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:05.613718 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-0ace1c42-bc39-4269-b732-7df3d0bac3f5 req-3069bfa7-2ce3-4059-a0fd-471e45e94118 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:05.633290 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-0ace1c42-bc39-4269-b732-7df3d0bac3f5 req-3069bfa7-2ce3-4059-a0fd-471e45e94118 service nova] Creating event network-vif-plugged:3e68f997-7180-47a9-a1f0-ae3a5f70d0a3 for instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b on hv-cinder-83735 Jun 16 17:25:05.641250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-0ace1c42-bc39-4269-b732-7df3d0bac3f5 req-3069bfa7-2ce3-4059-a0fd-471e45e94118 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042234 Jun 16 17:25:05.641882 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 164/325] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:25:05.836196 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b5096926-5383-42ed-995e-858f33443591 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:05.852289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b5096926-5383-42ed-995e-858f33443591 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 200 len: 1317 microversion: 2.1 time: 0.544377 Jun 16 17:25:05.854264 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 162/326] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:05 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 1317 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:05.915189 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-754931f8-2a34-480e-9b26-678951bef5c3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:05.917544 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-754931f8-2a34-480e-9b26-678951bef5c3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:05.921524 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:05.932788 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=6 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:05.939313 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-754931f8-2a34-480e-9b26-678951bef5c3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:05.940441 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-754931f8-2a34-480e-9b26-678951bef5c3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:05.943438 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-754931f8-2a34-480e-9b26-678951bef5c3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:05.944514 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-754931f8-2a34-480e-9b26-678951bef5c3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:06.040957 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4441933d-11ba-465b-8c59-260c0015eaab tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:06.045018 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4441933d-11ba-465b-8c59-260c0015eaab tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:06.085494 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4441933d-11ba-465b-8c59-260c0015eaab tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:06.086688 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4441933d-11ba-465b-8c59-260c0015eaab tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:06.089467 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4441933d-11ba-465b-8c59-260c0015eaab tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:06.091553 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4441933d-11ba-465b-8c59-260c0015eaab tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:06.194242 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=14 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:06.384015 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-754931f8-2a34-480e-9b26-678951bef5c3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:06.396603 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-754931f8-2a34-480e-9b26-678951bef5c3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:06.398746 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-754931f8-2a34-480e-9b26-678951bef5c3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:06.400565 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-754931f8-2a34-480e-9b26-678951bef5c3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1742 microversion: 2.20 time: 0.497280 Jun 16 17:25:06.401404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 165/327] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:05 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1742 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:06.474370 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4441933d-11ba-465b-8c59-260c0015eaab tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:06.497037 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4441933d-11ba-465b-8c59-260c0015eaab tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1369 microversion: 2.1 time: 0.465830 Jun 16 17:25:06.498261 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 163/328] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:06 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1369 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:25:06.614484 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-4a971cd6-d6f6-413c-a03d-44d945b7cace tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:06.616403 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-4a971cd6-d6f6-413c-a03d-44d945b7cace tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:06.627220 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4a971cd6-d6f6-413c-a03d-44d945b7cace tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:06.629668 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4a971cd6-d6f6-413c-a03d-44d945b7cace tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:06.631495 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4a971cd6-d6f6-413c-a03d-44d945b7cace tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:06.632171 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4a971cd6-d6f6-413c-a03d-44d945b7cace tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:06.873065 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-9e298d47-4ea5-4c2b-9709-e39ee1c9c455 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:06.873862 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-9e298d47-4ea5-4c2b-9709-e39ee1c9c455 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:06.885214 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9e298d47-4ea5-4c2b-9709-e39ee1c9c455 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:06.885945 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9e298d47-4ea5-4c2b-9709-e39ee1c9c455 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:06.886732 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9e298d47-4ea5-4c2b-9709-e39ee1c9c455 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:06.887934 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9e298d47-4ea5-4c2b-9709-e39ee1c9c455 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:06.935118 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-4a971cd6-d6f6-413c-a03d-44d945b7cace tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:06.954772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-4a971cd6-d6f6-413c-a03d-44d945b7cace tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1723 microversion: 2.1 time: 0.353481 Jun 16 17:25:06.961826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 166/329] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:06 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:25:07.215620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-9e298d47-4ea5-4c2b-9709-e39ee1c9c455 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:07.231313 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-9e298d47-4ea5-4c2b-9709-e39ee1c9c455 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 200 len: 1317 microversion: 2.1 time: 0.362498 Jun 16 17:25:07.238257 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 164/330] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:06 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:07.432126 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5226be65-eeb0-4915-a063-6742bae2ae4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:07.434779 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-5226be65-eeb0-4915-a063-6742bae2ae4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:07.443888 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5226be65-eeb0-4915-a063-6742bae2ae4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:07.444817 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5226be65-eeb0-4915-a063-6742bae2ae4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:07.446852 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5226be65-eeb0-4915-a063-6742bae2ae4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:07.447721 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5226be65-eeb0-4915-a063-6742bae2ae4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:07.516172 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5f7ad7e1-4524-44fd-ae94-7598728faa57 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:07.516875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5f7ad7e1-4524-44fd-ae94-7598728faa57 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:07.533273 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5f7ad7e1-4524-44fd-ae94-7598728faa57 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:07.533801 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5f7ad7e1-4524-44fd-ae94-7598728faa57 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:07.534700 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5f7ad7e1-4524-44fd-ae94-7598728faa57 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:07.540948 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5f7ad7e1-4524-44fd-ae94-7598728faa57 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:07.812476 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-5f7ad7e1-4524-44fd-ae94-7598728faa57 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:07.813217 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5226be65-eeb0-4915-a063-6742bae2ae4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:07.844618 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5f7ad7e1-4524-44fd-ae94-7598728faa57 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1369 microversion: 2.1 time: 0.315059 Jun 16 17:25:07.844618 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 165/331] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:07 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1369 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:07.845208 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5226be65-eeb0-4915-a063-6742bae2ae4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:07.845208 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5226be65-eeb0-4915-a063-6742bae2ae4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:07.845208 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-5226be65-eeb0-4915-a063-6742bae2ae4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1737 microversion: 2.20 time: 0.415250 Jun 16 17:25:07.845485 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 167/332] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:07 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1737 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:07.984053 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-351393ad-f470-44bb-941a-aa9902b5a8de tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:07.985194 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-351393ad-f470-44bb-941a-aa9902b5a8de tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:07.992547 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-351393ad-f470-44bb-941a-aa9902b5a8de tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:07.993411 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-351393ad-f470-44bb-941a-aa9902b5a8de tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:07.994705 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-351393ad-f470-44bb-941a-aa9902b5a8de tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:07.995437 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-351393ad-f470-44bb-941a-aa9902b5a8de tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:08.255513 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-23848411-0110-4ce5-ab02-d6e26e79eba3 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:08.256598 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-23848411-0110-4ce5-ab02-d6e26e79eba3 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:08.262323 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:08.288639 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-23848411-0110-4ce5-ab02-d6e26e79eba3 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:08.294174 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-351393ad-f470-44bb-941a-aa9902b5a8de tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:08.294779 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-23848411-0110-4ce5-ab02-d6e26e79eba3 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:08.296567 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-23848411-0110-4ce5-ab02-d6e26e79eba3 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:08.302925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-23848411-0110-4ce5-ab02-d6e26e79eba3 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:08.330789 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-351393ad-f470-44bb-941a-aa9902b5a8de tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1723 microversion: 2.1 time: 0.352114 Jun 16 17:25:08.331543 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 166/333] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:07 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1723 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:08.527311 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-23848411-0110-4ce5-ab02-d6e26e79eba3 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:08.537070 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-23848411-0110-4ce5-ab02-d6e26e79eba3 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 200 len: 1317 microversion: 2.1 time: 0.285877 Jun 16 17:25:08.537980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 168/334] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:08 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:25:08.819204 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-6e571707-bcae-4e6f-b0e6-9d84b298b3aa req-40b6e2e9-6ce8-45dc-a53c-dbb1e147be99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e36f5bc-922d-4dfe-9ecb-49ba6c855878", "name": "network-vif-plugged", "status": "completed", "tag": "9e73391a-9d05-40e7-8c63-8913ccd9e1bc"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:25:08.834125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-6e571707-bcae-4e6f-b0e6-9d84b298b3aa req-40b6e2e9-6ce8-45dc-a53c-dbb1e147be99 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:08.834847 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-6e571707-bcae-4e6f-b0e6-9d84b298b3aa req-40b6e2e9-6ce8-45dc-a53c-dbb1e147be99 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:08.855687 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-79650559-f6fd-4282-b8fa-a2bd0ef70325 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:08.856694 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-79650559-f6fd-4282-b8fa-a2bd0ef70325 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:08.865654 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-6e571707-bcae-4e6f-b0e6-9d84b298b3aa req-40b6e2e9-6ce8-45dc-a53c-dbb1e147be99 service nova] Creating event network-vif-plugged:9e73391a-9d05-40e7-8c63-8913ccd9e1bc for instance 0e36f5bc-922d-4dfe-9ecb-49ba6c855878 on hv-cinder-83735 Jun 16 17:25:08.874545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-79650559-f6fd-4282-b8fa-a2bd0ef70325 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:08.875033 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-79650559-f6fd-4282-b8fa-a2bd0ef70325 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:08.875784 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-79650559-f6fd-4282-b8fa-a2bd0ef70325 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:08.877684 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-79650559-f6fd-4282-b8fa-a2bd0ef70325 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:08.886595 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-6e571707-bcae-4e6f-b0e6-9d84b298b3aa req-40b6e2e9-6ce8-45dc-a53c-dbb1e147be99 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070645 Jun 16 17:25:08.888271 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 167/335] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:25:08.898051 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a5367e1f-423f-4547-9a76-619084700319 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:08.899074 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a5367e1f-423f-4547-9a76-619084700319 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:08.907008 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a5367e1f-423f-4547-9a76-619084700319 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:08.907529 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a5367e1f-423f-4547-9a76-619084700319 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:08.908537 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a5367e1f-423f-4547-9a76-619084700319 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:08.909144 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a5367e1f-423f-4547-9a76-619084700319 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:09.224287 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-79650559-f6fd-4282-b8fa-a2bd0ef70325 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:09.240492 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-79650559-f6fd-4282-b8fa-a2bd0ef70325 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1563 microversion: 2.1 time: 0.391268 Jun 16 17:25:09.275933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 169/336] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:08 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1563 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:25:09.300888 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b03ef817-0c34-40eb-8924-dbaafb9dbacb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:09.302107 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b03ef817-0c34-40eb-8924-dbaafb9dbacb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:09.316694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a5367e1f-423f-4547-9a76-619084700319 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:09.324807 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b03ef817-0c34-40eb-8924-dbaafb9dbacb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:09.325826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b03ef817-0c34-40eb-8924-dbaafb9dbacb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:09.340477 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b03ef817-0c34-40eb-8924-dbaafb9dbacb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:09.341345 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b03ef817-0c34-40eb-8924-dbaafb9dbacb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:09.344933 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a5367e1f-423f-4547-9a76-619084700319 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:09.355224 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a5367e1f-423f-4547-9a76-619084700319 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:09.358691 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a5367e1f-423f-4547-9a76-619084700319 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1737 microversion: 2.20 time: 0.469088 Jun 16 17:25:09.361876 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 168/337] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:08 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1737 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:09.383212 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-813eff58-1e27-4807-ab12-53975fa821d7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:09.388796 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-813eff58-1e27-4807-ab12-53975fa821d7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:09.400036 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-813eff58-1e27-4807-ab12-53975fa821d7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:09.400934 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-813eff58-1e27-4807-ab12-53975fa821d7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:09.408304 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-813eff58-1e27-4807-ab12-53975fa821d7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:09.409690 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-813eff58-1e27-4807-ab12-53975fa821d7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:09.547696 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b03ef817-0c34-40eb-8924-dbaafb9dbacb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.270180 Jun 16 17:25:09.549294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 170/338] 10.222.0.66 () {58 vars in 1274 bytes} [Thu Jun 16 17:25:09 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/os-interface => generated 284 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:25:09.558404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-4538b431-b56e-4980-85c6-3bb857055169 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:09.567216 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-4538b431-b56e-4980-85c6-3bb857055169 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:09.581835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4538b431-b56e-4980-85c6-3bb857055169 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:09.583307 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4538b431-b56e-4980-85c6-3bb857055169 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:09.584792 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4538b431-b56e-4980-85c6-3bb857055169 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:09.585612 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4538b431-b56e-4980-85c6-3bb857055169 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:10.067404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-4538b431-b56e-4980-85c6-3bb857055169 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:10.077427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-813eff58-1e27-4807-ab12-53975fa821d7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:10.091711 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-4538b431-b56e-4980-85c6-3bb857055169 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 200 len: 1317 microversion: 2.1 time: 0.524337 Jun 16 17:25:10.094538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 171/339] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:09 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 1317 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:10.096553 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-813eff58-1e27-4807-ab12-53975fa821d7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1723 microversion: 2.1 time: 0.731928 Jun 16 17:25:10.116574 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 169/340] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:09 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1723 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:10.402293 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a7187468-97fd-4cf5-9412-35af71ff9e7e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:10.403445 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a7187468-97fd-4cf5-9412-35af71ff9e7e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:10.419705 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a7187468-97fd-4cf5-9412-35af71ff9e7e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:10.421587 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a7187468-97fd-4cf5-9412-35af71ff9e7e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:10.426446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a7187468-97fd-4cf5-9412-35af71ff9e7e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:10.427070 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a7187468-97fd-4cf5-9412-35af71ff9e7e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:10.920981 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-4e4a1493-c416-420e-8eea-62510b889dc2 req-e651acae-b99d-4ecb-86ac-1062da6e5f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2e7148-fa86-4648-9e4b-87e27fcf1147", "name": "network-vif-plugged", "status": "completed", "tag": "2da50d5c-d328-4853-a261-6bd0c6378dcd"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:25:10.950689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-4e4a1493-c416-420e-8eea-62510b889dc2 req-e651acae-b99d-4ecb-86ac-1062da6e5f4f service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:10.952203 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-4e4a1493-c416-420e-8eea-62510b889dc2 req-e651acae-b99d-4ecb-86ac-1062da6e5f4f service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:10.969769 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=100 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:11.023535 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-4e4a1493-c416-420e-8eea-62510b889dc2 req-e651acae-b99d-4ecb-86ac-1062da6e5f4f service nova] Creating event network-vif-plugged:2da50d5c-d328-4853-a261-6bd0c6378dcd for instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 on hv-cinder-83735 Jun 16 17:25:11.039237 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-4e4a1493-c416-420e-8eea-62510b889dc2 req-e651acae-b99d-4ecb-86ac-1062da6e5f4f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123952 Jun 16 17:25:11.040622 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 170/341] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:25:11.117384 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-bab38b28-bc2f-419f-8fbf-1197a93461f1 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:11.118229 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-bab38b28-bc2f-419f-8fbf-1197a93461f1 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:11.161642 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bab38b28-bc2f-419f-8fbf-1197a93461f1 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:11.162156 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bab38b28-bc2f-419f-8fbf-1197a93461f1 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:11.163011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bab38b28-bc2f-419f-8fbf-1197a93461f1 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:11.171259 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bab38b28-bc2f-419f-8fbf-1197a93461f1 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:11.418630 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a7187468-97fd-4cf5-9412-35af71ff9e7e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:11.436484 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a7187468-97fd-4cf5-9412-35af71ff9e7e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:11.443044 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a7187468-97fd-4cf5-9412-35af71ff9e7e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:11.444744 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a7187468-97fd-4cf5-9412-35af71ff9e7e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1737 microversion: 2.20 time: 1.066286 Jun 16 17:25:11.447970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 172/342] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:10 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1737 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:11.454979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-204c54fc-d505-4e33-83d6-78a6e6ea316a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:11.459011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-204c54fc-d505-4e33-83d6-78a6e6ea316a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:11.488165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-204c54fc-d505-4e33-83d6-78a6e6ea316a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:11.488969 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-204c54fc-d505-4e33-83d6-78a6e6ea316a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:11.505330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-204c54fc-d505-4e33-83d6-78a6e6ea316a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:11.510541 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-204c54fc-d505-4e33-83d6-78a6e6ea316a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:11.704764 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-bab38b28-bc2f-419f-8fbf-1197a93461f1 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:11.716521 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-bab38b28-bc2f-419f-8fbf-1197a93461f1 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 200 len: 1317 microversion: 2.1 time: 0.608173 Jun 16 17:25:11.717655 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 171/343] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:11 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 1317 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:25:12.112329 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-204c54fc-d505-4e33-83d6-78a6e6ea316a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:12.148577 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-204c54fc-d505-4e33-83d6-78a6e6ea316a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1723 microversion: 2.1 time: 0.698933 Jun 16 17:25:12.150778 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 173/344] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:11 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1723 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:12.481082 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ef86d832-6e3c-4c1f-b724-61ba1a9ea3ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:12.481921 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ef86d832-6e3c-4c1f-b724-61ba1a9ea3ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:12.516146 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ef86d832-6e3c-4c1f-b724-61ba1a9ea3ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:12.516677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ef86d832-6e3c-4c1f-b724-61ba1a9ea3ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:12.518843 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ef86d832-6e3c-4c1f-b724-61ba1a9ea3ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:12.520020 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ef86d832-6e3c-4c1f-b724-61ba1a9ea3ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:12.735493 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-92b218b1-dfe1-4fc2-a5c7-8e80c1be7dbf tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:12.736268 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-92b218b1-dfe1-4fc2-a5c7-8e80c1be7dbf tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:12.760105 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-92b218b1-dfe1-4fc2-a5c7-8e80c1be7dbf tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:12.760609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-92b218b1-dfe1-4fc2-a5c7-8e80c1be7dbf tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:12.771249 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-92b218b1-dfe1-4fc2-a5c7-8e80c1be7dbf tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:12.772567 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-92b218b1-dfe1-4fc2-a5c7-8e80c1be7dbf tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:13.745288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ef86d832-6e3c-4c1f-b724-61ba1a9ea3ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:13.766362 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ef86d832-6e3c-4c1f-b724-61ba1a9ea3ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:13.768839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ef86d832-6e3c-4c1f-b724-61ba1a9ea3ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:13.771019 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ef86d832-6e3c-4c1f-b724-61ba1a9ea3ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1737 microversion: 2.20 time: 1.299040 Jun 16 17:25:13.772723 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 172/345] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:12 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1737 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:13.788352 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7538fb7f-f7fc-4a7f-8cdc-435a8e4026a5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:13.790235 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-7538fb7f-f7fc-4a7f-8cdc-435a8e4026a5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:13.808324 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7538fb7f-f7fc-4a7f-8cdc-435a8e4026a5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:13.824424 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7538fb7f-f7fc-4a7f-8cdc-435a8e4026a5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:13.825439 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7538fb7f-f7fc-4a7f-8cdc-435a8e4026a5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:13.825883 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7538fb7f-f7fc-4a7f-8cdc-435a8e4026a5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:13.914126 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-92b218b1-dfe1-4fc2-a5c7-8e80c1be7dbf tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:13.936286 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-92b218b1-dfe1-4fc2-a5c7-8e80c1be7dbf tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 200 len: 1507 microversion: 2.1 time: 1.205692 Jun 16 17:25:13.939194 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 174/346] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:12 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 1507 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:14.320242 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7538fb7f-f7fc-4a7f-8cdc-435a8e4026a5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:14.338354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7538fb7f-f7fc-4a7f-8cdc-435a8e4026a5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1723 microversion: 2.1 time: 0.563652 Jun 16 17:25:14.339069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 173/347] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:13 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1723 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:14.537754 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-b343e606-b1e5-4d5d-8534-d21da7465e8b req-9f826aa7-7e15-4e7e-93c0-bc605388074b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4065d5c1-0b16-413a-a5b5-e0e725e1e71b", "tag": "3e68f997-7180-47a9-a1f0-ae3a5f70d0a3"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:25:14.590694 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-b343e606-b1e5-4d5d-8534-d21da7465e8b req-9f826aa7-7e15-4e7e-93c0-bc605388074b service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:14.595438 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-b343e606-b1e5-4d5d-8534-d21da7465e8b req-9f826aa7-7e15-4e7e-93c0-bc605388074b service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:14.625842 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-b343e606-b1e5-4d5d-8534-d21da7465e8b req-9f826aa7-7e15-4e7e-93c0-bc605388074b service nova] Creating event network-changed:3e68f997-7180-47a9-a1f0-ae3a5f70d0a3 for instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b on hv-cinder-83735 Jun 16 17:25:14.647307 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-b343e606-b1e5-4d5d-8534-d21da7465e8b req-9f826aa7-7e15-4e7e-93c0-bc605388074b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118873 Jun 16 17:25:14.649208 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 175/348] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:25:14.794424 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-89ed2555-8cf7-4ffc-b7be-790f2e447ab8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:14.795755 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-89ed2555-8cf7-4ffc-b7be-790f2e447ab8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:14.815403 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-89ed2555-8cf7-4ffc-b7be-790f2e447ab8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:14.817051 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-89ed2555-8cf7-4ffc-b7be-790f2e447ab8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:14.820216 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-89ed2555-8cf7-4ffc-b7be-790f2e447ab8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:14.827239 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-89ed2555-8cf7-4ffc-b7be-790f2e447ab8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:15.300813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-89ed2555-8cf7-4ffc-b7be-790f2e447ab8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:15.311615 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-89ed2555-8cf7-4ffc-b7be-790f2e447ab8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:15.325595 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-89ed2555-8cf7-4ffc-b7be-790f2e447ab8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:15.332552 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-89ed2555-8cf7-4ffc-b7be-790f2e447ab8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1737 microversion: 2.20 time: 0.543407 Jun 16 17:25:15.345438 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 174/349] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:14 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1737 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:15.362877 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8ad42876-ef9c-4e48-9d62-adcc76a76da0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:15.364518 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8ad42876-ef9c-4e48-9d62-adcc76a76da0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:15.373841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ad42876-ef9c-4e48-9d62-adcc76a76da0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:15.374708 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ad42876-ef9c-4e48-9d62-adcc76a76da0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:15.375874 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ad42876-ef9c-4e48-9d62-adcc76a76da0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:15.376466 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ad42876-ef9c-4e48-9d62-adcc76a76da0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:16.241016 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8ad42876-ef9c-4e48-9d62-adcc76a76da0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:16.244405 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:16.262216 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8ad42876-ef9c-4e48-9d62-adcc76a76da0 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1700 microversion: 2.1 time: 0.908129 Jun 16 17:25:16.278787 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 176/350] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:15 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1700 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:16.283822 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-1cc3491e-4792-44f0-838f-17335e32a533 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:25:16.291960 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1cc3491e-4792-44f0-838f-17335e32a533 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:16.292928 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1cc3491e-4792-44f0-838f-17335e32a533 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:16.359258 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-089f4ad1-aa90-456f-b2c8-7d831035621c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:16.366533 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-089f4ad1-aa90-456f-b2c8-7d831035621c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:16.396098 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-089f4ad1-aa90-456f-b2c8-7d831035621c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:16.399133 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-089f4ad1-aa90-456f-b2c8-7d831035621c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:16.407853 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-089f4ad1-aa90-456f-b2c8-7d831035621c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:16.408678 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-089f4ad1-aa90-456f-b2c8-7d831035621c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:16.564539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-1cc3491e-4792-44f0-838f-17335e32a533 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Going to try to start instance {{(pid=117553) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 17:25:16.804960 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-1cc3491e-4792-44f0-838f-17335e32a533 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "POST /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/action" status: 202 len: 0 microversion: 2.1 time: 0.524456 Jun 16 17:25:16.806226 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 175/351] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jun 16 17:25:16 2022] POST /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:25:16.872447 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f9c444bb-51d7-4830-8357-1a7cac95540c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:16.873989 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f9c444bb-51d7-4830-8357-1a7cac95540c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:16.895764 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f9c444bb-51d7-4830-8357-1a7cac95540c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:16.896802 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f9c444bb-51d7-4830-8357-1a7cac95540c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:16.897631 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f9c444bb-51d7-4830-8357-1a7cac95540c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:16.898285 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f9c444bb-51d7-4830-8357-1a7cac95540c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:17.318144 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-089f4ad1-aa90-456f-b2c8-7d831035621c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:17.335995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-089f4ad1-aa90-456f-b2c8-7d831035621c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:17.338431 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-089f4ad1-aa90-456f-b2c8-7d831035621c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:17.339977 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-089f4ad1-aa90-456f-b2c8-7d831035621c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1737 microversion: 2.20 time: 0.986999 Jun 16 17:25:17.347050 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 177/352] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:16 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1737 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:17.514305 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-f9c444bb-51d7-4830-8357-1a7cac95540c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:17.533461 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f9c444bb-51d7-4830-8357-1a7cac95540c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1709 microversion: 2.1 time: 0.706775 Jun 16 17:25:17.544927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 176/353] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:16 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1709 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:18.375592 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0cf1b126-8ff1-4dec-804d-809fa8bfcd2a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:18.381926 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0cf1b126-8ff1-4dec-804d-809fa8bfcd2a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:18.410754 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0cf1b126-8ff1-4dec-804d-809fa8bfcd2a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:18.412959 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0cf1b126-8ff1-4dec-804d-809fa8bfcd2a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:18.417840 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0cf1b126-8ff1-4dec-804d-809fa8bfcd2a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:18.420654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0cf1b126-8ff1-4dec-804d-809fa8bfcd2a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:18.564583 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-6d9f9da7-6846-4d92-b462-6fb66e7ccd51 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:18.566364 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-6d9f9da7-6846-4d92-b462-6fb66e7ccd51 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:18.600309 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6d9f9da7-6846-4d92-b462-6fb66e7ccd51 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:18.601481 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6d9f9da7-6846-4d92-b462-6fb66e7ccd51 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:18.605814 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6d9f9da7-6846-4d92-b462-6fb66e7ccd51 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:18.610006 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6d9f9da7-6846-4d92-b462-6fb66e7ccd51 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:19.370725 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0cf1b126-8ff1-4dec-804d-809fa8bfcd2a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:19.382052 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0cf1b126-8ff1-4dec-804d-809fa8bfcd2a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:19.391446 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6d9f9da7-6846-4d92-b462-6fb66e7ccd51 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:19.397567 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0cf1b126-8ff1-4dec-804d-809fa8bfcd2a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:19.399525 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0cf1b126-8ff1-4dec-804d-809fa8bfcd2a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1737 microversion: 2.20 time: 1.029440 Jun 16 17:25:19.400589 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 178/354] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:18 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1737 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:19.444980 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-6d9f9da7-6846-4d92-b462-6fb66e7ccd51 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1709 microversion: 2.1 time: 0.885257 Jun 16 17:25:19.446344 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 177/355] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:18 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1709 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:25:20.422316 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-931a165c-90a8-4469-8a93-865e0020840b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:20.424142 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-931a165c-90a8-4469-8a93-865e0020840b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:20.469712 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-49a826f6-769f-40c7-9599-3a7396b421cc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:20.470285 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-49a826f6-769f-40c7-9599-3a7396b421cc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:20.482130 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-931a165c-90a8-4469-8a93-865e0020840b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:20.493938 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-931a165c-90a8-4469-8a93-865e0020840b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:20.495914 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-49a826f6-769f-40c7-9599-3a7396b421cc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:20.499817 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-49a826f6-769f-40c7-9599-3a7396b421cc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:20.501025 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-49a826f6-769f-40c7-9599-3a7396b421cc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:20.501534 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-931a165c-90a8-4469-8a93-865e0020840b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:20.502189 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-931a165c-90a8-4469-8a93-865e0020840b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:20.504219 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-49a826f6-769f-40c7-9599-3a7396b421cc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:21.100966 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-49a826f6-769f-40c7-9599-3a7396b421cc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:21.112861 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-49a826f6-769f-40c7-9599-3a7396b421cc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1709 microversion: 2.1 time: 0.647639 Jun 16 17:25:21.124170 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 178/356] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:20 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1709 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:21.144822 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-931a165c-90a8-4469-8a93-865e0020840b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:21.167057 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-931a165c-90a8-4469-8a93-865e0020840b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:21.172442 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-931a165c-90a8-4469-8a93-865e0020840b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:21.180405 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-931a165c-90a8-4469-8a93-865e0020840b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1737 microversion: 2.20 time: 0.762395 Jun 16 17:25:21.186932 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 179/357] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:20 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1737 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:22.143703 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-48a04b3e-086c-4156-a810-a53d1ed4c55c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:22.145001 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-48a04b3e-086c-4156-a810-a53d1ed4c55c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:22.178702 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-48a04b3e-086c-4156-a810-a53d1ed4c55c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:22.180834 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-48a04b3e-086c-4156-a810-a53d1ed4c55c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:22.182890 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-48a04b3e-086c-4156-a810-a53d1ed4c55c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:22.183377 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-48a04b3e-086c-4156-a810-a53d1ed4c55c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:22.208674 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ed4a0969-32da-46b4-9049-904f38638160 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:22.209350 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ed4a0969-32da-46b4-9049-904f38638160 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:22.254073 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ed4a0969-32da-46b4-9049-904f38638160 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:22.275251 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ed4a0969-32da-46b4-9049-904f38638160 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:22.276162 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ed4a0969-32da-46b4-9049-904f38638160 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:22.276634 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ed4a0969-32da-46b4-9049-904f38638160 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:23.197398 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ed4a0969-32da-46b4-9049-904f38638160 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:23.214331 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ed4a0969-32da-46b4-9049-904f38638160 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:23.220864 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ed4a0969-32da-46b4-9049-904f38638160 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:23.226150 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ed4a0969-32da-46b4-9049-904f38638160 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1737 microversion: 2.20 time: 1.021652 Jun 16 17:25:23.241505 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 180/358] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:22 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1737 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:25:23.523492 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-48a04b3e-086c-4156-a810-a53d1ed4c55c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:23.547641 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-48a04b3e-086c-4156-a810-a53d1ed4c55c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1713 microversion: 2.1 time: 1.409031 Jun 16 17:25:23.548260 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 179/359] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:22 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1713 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:24.250057 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0e8a5ff3-6697-4c5e-94f6-b4edbb37a7f4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:24.251628 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0e8a5ff3-6697-4c5e-94f6-b4edbb37a7f4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:24.261489 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0e8a5ff3-6697-4c5e-94f6-b4edbb37a7f4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:24.306845 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0e8a5ff3-6697-4c5e-94f6-b4edbb37a7f4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.045s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:24.310582 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0e8a5ff3-6697-4c5e-94f6-b4edbb37a7f4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:24.311027 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0e8a5ff3-6697-4c5e-94f6-b4edbb37a7f4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:24.970527 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0e8a5ff3-6697-4c5e-94f6-b4edbb37a7f4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:24.987075 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0e8a5ff3-6697-4c5e-94f6-b4edbb37a7f4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:24.995294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0e8a5ff3-6697-4c5e-94f6-b4edbb37a7f4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:25.002176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0e8a5ff3-6697-4c5e-94f6-b4edbb37a7f4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1737 microversion: 2.20 time: 0.753217 Jun 16 17:25:25.003564 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 181/360] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:24 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1737 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:26.034536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-e7451b5e-44f4-4301-a7d3-58dc7646c76c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:26.043076 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-e7451b5e-44f4-4301-a7d3-58dc7646c76c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:26.071286 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e7451b5e-44f4-4301-a7d3-58dc7646c76c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:26.071909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e7451b5e-44f4-4301-a7d3-58dc7646c76c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:26.074352 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e7451b5e-44f4-4301-a7d3-58dc7646c76c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:26.075826 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e7451b5e-44f4-4301-a7d3-58dc7646c76c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:26.404340 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e7451b5e-44f4-4301-a7d3-58dc7646c76c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:26.418316 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e7451b5e-44f4-4301-a7d3-58dc7646c76c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:26.423928 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e7451b5e-44f4-4301-a7d3-58dc7646c76c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:26.426917 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-e7451b5e-44f4-4301-a7d3-58dc7646c76c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1737 microversion: 2.20 time: 0.400030 Jun 16 17:25:26.432569 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 180/361] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:26 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1737 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:25:27.449277 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-64b832ec-9b0f-4ca6-a759-3d9408cca4e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:27.449993 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-64b832ec-9b0f-4ca6-a759-3d9408cca4e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:27.463914 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-64b832ec-9b0f-4ca6-a759-3d9408cca4e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:27.467899 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-64b832ec-9b0f-4ca6-a759-3d9408cca4e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:27.468971 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-64b832ec-9b0f-4ca6-a759-3d9408cca4e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:27.473204 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-64b832ec-9b0f-4ca6-a759-3d9408cca4e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:27.927015 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-64b832ec-9b0f-4ca6-a759-3d9408cca4e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:27.945787 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-64b832ec-9b0f-4ca6-a759-3d9408cca4e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:27.949021 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-64b832ec-9b0f-4ca6-a759-3d9408cca4e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:27.950566 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-64b832ec-9b0f-4ca6-a759-3d9408cca4e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1737 microversion: 2.20 time: 0.506742 Jun 16 17:25:27.951687 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 182/362] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:27 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1737 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:28.972128 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-9118c1eb-136f-4231-b90b-2ce2c5bd2937 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:28.972925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-9118c1eb-136f-4231-b90b-2ce2c5bd2937 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:28.990551 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=58 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:28.997626 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9118c1eb-136f-4231-b90b-2ce2c5bd2937 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:29.002811 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9118c1eb-136f-4231-b90b-2ce2c5bd2937 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:29.004035 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9118c1eb-136f-4231-b90b-2ce2c5bd2937 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:29.004683 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9118c1eb-136f-4231-b90b-2ce2c5bd2937 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:29.846499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-9118c1eb-136f-4231-b90b-2ce2c5bd2937 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:29.869009 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-9118c1eb-136f-4231-b90b-2ce2c5bd2937 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:29.878052 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-9118c1eb-136f-4231-b90b-2ce2c5bd2937 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:29.885542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-9118c1eb-136f-4231-b90b-2ce2c5bd2937 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1737 microversion: 2.20 time: 0.914241 Jun 16 17:25:29.903041 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 181/363] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:28 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1737 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:25:30.927488 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-1d09bb15-04cd-4f24-bd29-d8c14f24dee9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:30.928817 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-1d09bb15-04cd-4f24-bd29-d8c14f24dee9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:30.954716 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1d09bb15-04cd-4f24-bd29-d8c14f24dee9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:30.959106 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1d09bb15-04cd-4f24-bd29-d8c14f24dee9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:30.960225 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1d09bb15-04cd-4f24-bd29-d8c14f24dee9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:30.963862 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1d09bb15-04cd-4f24-bd29-d8c14f24dee9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:31.318494 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-1d09bb15-04cd-4f24-bd29-d8c14f24dee9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:31.337382 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-1d09bb15-04cd-4f24-bd29-d8c14f24dee9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:31.342328 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-1d09bb15-04cd-4f24-bd29-d8c14f24dee9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:31.346560 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-1d09bb15-04cd-4f24-bd29-d8c14f24dee9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1737 microversion: 2.20 time: 0.423153 Jun 16 17:25:31.356687 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 183/364] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:30 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1737 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:32.381013 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-434911d1-7d3e-4866-bd8a-7bc50421f8d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:32.381905 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-434911d1-7d3e-4866-bd8a-7bc50421f8d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:32.392373 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-434911d1-7d3e-4866-bd8a-7bc50421f8d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:32.392805 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-434911d1-7d3e-4866-bd8a-7bc50421f8d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:32.395707 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-434911d1-7d3e-4866-bd8a-7bc50421f8d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:32.399466 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-434911d1-7d3e-4866-bd8a-7bc50421f8d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:33.264968 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-434911d1-7d3e-4866-bd8a-7bc50421f8d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:33.276253 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-434911d1-7d3e-4866-bd8a-7bc50421f8d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:33.277948 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-434911d1-7d3e-4866-bd8a-7bc50421f8d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:33.279067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-434911d1-7d3e-4866-bd8a-7bc50421f8d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1737 microversion: 2.20 time: 0.902267 Jun 16 17:25:33.307149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 182/365] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:32 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1737 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:34.298429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-2df45bab-2d48-4e4e-9343-71b5600f0927 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:34.300167 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-2df45bab-2d48-4e4e-9343-71b5600f0927 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:34.316793 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2df45bab-2d48-4e4e-9343-71b5600f0927 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:34.320496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2df45bab-2d48-4e4e-9343-71b5600f0927 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:34.322532 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2df45bab-2d48-4e4e-9343-71b5600f0927 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:34.325125 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2df45bab-2d48-4e4e-9343-71b5600f0927 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:35.048801 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2df45bab-2d48-4e4e-9343-71b5600f0927 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:35.063942 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2df45bab-2d48-4e4e-9343-71b5600f0927 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:35.071640 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2df45bab-2d48-4e4e-9343-71b5600f0927 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:35.074421 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-2df45bab-2d48-4e4e-9343-71b5600f0927 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1737 microversion: 2.20 time: 0.779260 Jun 16 17:25:35.075132 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 184/366] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:34 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1737 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:36.113426 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f9f2b62b-e7d8-4ac5-a7b4-35ae7c1e3fef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:36.114088 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f9f2b62b-e7d8-4ac5-a7b4-35ae7c1e3fef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:36.152474 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f9f2b62b-e7d8-4ac5-a7b4-35ae7c1e3fef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:36.154023 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f9f2b62b-e7d8-4ac5-a7b4-35ae7c1e3fef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:36.160491 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f9f2b62b-e7d8-4ac5-a7b4-35ae7c1e3fef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:36.161712 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f9f2b62b-e7d8-4ac5-a7b4-35ae7c1e3fef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:36.505627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-f9f2b62b-e7d8-4ac5-a7b4-35ae7c1e3fef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:36.520632 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-f9f2b62b-e7d8-4ac5-a7b4-35ae7c1e3fef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:36.525914 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-f9f2b62b-e7d8-4ac5-a7b4-35ae7c1e3fef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:36.532924 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f9f2b62b-e7d8-4ac5-a7b4-35ae7c1e3fef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1737 microversion: 2.20 time: 0.439774 Jun 16 17:25:36.537918 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 183/367] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:36 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1737 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:37.556670 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8c083199-d71c-4de1-8e4d-3bbcb2cdc5b3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:37.557855 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-8c083199-d71c-4de1-8e4d-3bbcb2cdc5b3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:37.568994 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8c083199-d71c-4de1-8e4d-3bbcb2cdc5b3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:37.577105 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8c083199-d71c-4de1-8e4d-3bbcb2cdc5b3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:37.581999 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8c083199-d71c-4de1-8e4d-3bbcb2cdc5b3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:37.583752 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8c083199-d71c-4de1-8e4d-3bbcb2cdc5b3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:37.838064 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f9a2ca7b-947d-42ab-abd6-45393fa536da tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Action: 'create', calling method: .version_select at 0x7f66b18645e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2110136853", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsLemJKLhQrMFE5Rtu4jKGjYxGBtPWMSys1YOiZRgpB3sEghHP2UJU6IAPspF9FMY6KwYc/Djb7YaCFU0FrA5SIIZHtcEdkzfPNjuCoi4af6Dghy/OfUVSCt7sFeJMFVA=="}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:25:37.899002 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-f9a2ca7b-947d-42ab-abd6-45393fa536da tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Getting quotas for project bd1488226a424c6e9e7f94f31b020e4f. Resources: {'key_pairs'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:25:37.906638 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-f9a2ca7b-947d-42ab-abd6-45393fa536da tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Getting quotas for user fbbafeb56a4d4fd282275e4198ede783 and project bd1488226a424c6e9e7f94f31b020e4f. Resources: {'key_pairs'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:25:37.977625 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f9a2ca7b-947d-42ab-abd6-45393fa536da tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.506400 Jun 16 17:25:37.978428 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 185/368] 10.222.0.66 () {60 vars in 1158 bytes} [Thu Jun 16 17:25:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:25:38.014850 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8c083199-d71c-4de1-8e4d-3bbcb2cdc5b3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:38.047685 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8c083199-d71c-4de1-8e4d-3bbcb2cdc5b3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:38.054103 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8c083199-d71c-4de1-8e4d-3bbcb2cdc5b3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:38.058410 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8c083199-d71c-4de1-8e4d-3bbcb2cdc5b3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1719 microversion: 2.20 time: 0.505656 Jun 16 17:25:38.062379 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 184/369] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:37 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1719 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:39.083275 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8f291ac6-399f-407e-9fc5-f25e7c6b0d2e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:39.083275 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8f291ac6-399f-407e-9fc5-f25e7c6b0d2e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:39.083275 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:39.094147 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8f291ac6-399f-407e-9fc5-f25e7c6b0d2e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:39.095371 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8f291ac6-399f-407e-9fc5-f25e7c6b0d2e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:39.096684 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8f291ac6-399f-407e-9fc5-f25e7c6b0d2e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:39.097495 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8f291ac6-399f-407e-9fc5-f25e7c6b0d2e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:39.409317 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8f291ac6-399f-407e-9fc5-f25e7c6b0d2e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:39.423701 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8f291ac6-399f-407e-9fc5-f25e7c6b0d2e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:39.440215 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8f291ac6-399f-407e-9fc5-f25e7c6b0d2e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:39.446737 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8f291ac6-399f-407e-9fc5-f25e7c6b0d2e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1719 microversion: 2.20 time: 0.370206 Jun 16 17:25:39.467014 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 186/370] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:39 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1719 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:40.476755 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4154c4b5-b074-4a57-ba72-f796935774d0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:40.481955 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4154c4b5-b074-4a57-ba72-f796935774d0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:40.503598 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4154c4b5-b074-4a57-ba72-f796935774d0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:40.508147 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4154c4b5-b074-4a57-ba72-f796935774d0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:40.512550 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4154c4b5-b074-4a57-ba72-f796935774d0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:40.515182 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4154c4b5-b074-4a57-ba72-f796935774d0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:40.796056 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4154c4b5-b074-4a57-ba72-f796935774d0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:40.819429 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4154c4b5-b074-4a57-ba72-f796935774d0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:40.821570 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4154c4b5-b074-4a57-ba72-f796935774d0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:40.831764 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4154c4b5-b074-4a57-ba72-f796935774d0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1719 microversion: 2.20 time: 0.364961 Jun 16 17:25:40.858194 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 185/371] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:40 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1719 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:41.576312 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-2077fb83-fcd9-4aab-a137-57b4c60777e4 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2833bb92-c3be-4192-9031-ea888dfc80cd", "device": "/dev/sdb"}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:25:41.578759 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-2077fb83-fcd9-4aab-a137-57b4c60777e4 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:41.585375 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2077fb83-fcd9-4aab-a137-57b4c60777e4 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:41.586063 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2077fb83-fcd9-4aab-a137-57b4c60777e4 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:41.587012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2077fb83-fcd9-4aab-a137-57b4c60777e4 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:41.587580 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2077fb83-fcd9-4aab-a137-57b4c60777e4 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:41.888687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-74c01da1-e3d0-4199-9917-75b3610d0151 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:41.889580 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-74c01da1-e3d0-4199-9917-75b3610d0151 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:41.911887 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-74c01da1-e3d0-4199-9917-75b3610d0151 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:41.917949 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-74c01da1-e3d0-4199-9917-75b3610d0151 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:41.919239 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-74c01da1-e3d0-4199-9917-75b3610d0151 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:41.919831 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-74c01da1-e3d0-4199-9917-75b3610d0151 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:41.935713 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:42.102257 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-2077fb83-fcd9-4aab-a137-57b4c60777e4 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "POST /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.530655 Jun 16 17:25:42.102934 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 187/372] 10.222.0.66 () {60 vars in 1322 bytes} [Thu Jun 16 17:25:41 2022] POST /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878/os-volume_attachments => generated 194 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:25:42.173450 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-74c01da1-e3d0-4199-9917-75b3610d0151 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:42.187399 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-74c01da1-e3d0-4199-9917-75b3610d0151 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:42.189097 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-74c01da1-e3d0-4199-9917-75b3610d0151 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:42.190786 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-74c01da1-e3d0-4199-9917-75b3610d0151 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1662 microversion: 2.20 time: 0.307674 Jun 16 17:25:42.192394 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 186/373] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:41 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1662 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:42.211728 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8f3c41ef-9e0a-453d-85c2-c1a84d4e7c38 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ca60a11-11cb-47e7-a1db-8cc9a8aebc85"}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:25:42.214225 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8f3c41ef-9e0a-453d-85c2-c1a84d4e7c38 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:42.229257 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8f3c41ef-9e0a-453d-85c2-c1a84d4e7c38 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:42.230050 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8f3c41ef-9e0a-453d-85c2-c1a84d4e7c38 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:42.231121 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8f3c41ef-9e0a-453d-85c2-c1a84d4e7c38 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:42.231759 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8f3c41ef-9e0a-453d-85c2-c1a84d4e7c38 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:42.559588 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-5c017555-d6b5-429f-8b56-d00747118aa6 req-0fcdc262-6d63-4cac-8c38-0512fc216e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2e7148-fa86-4648-9e4b-87e27fcf1147", "name": "network-vif-unplugged", "status": "completed", "tag": "2da50d5c-d328-4853-a261-6bd0c6378dcd"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:25:42.578135 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-5c017555-d6b5-429f-8b56-d00747118aa6 req-0fcdc262-6d63-4cac-8c38-0512fc216e51 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:42.579379 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-5c017555-d6b5-429f-8b56-d00747118aa6 req-0fcdc262-6d63-4cac-8c38-0512fc216e51 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:42.595724 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.compute.server_external_events [req-5c017555-d6b5-429f-8b56-d00747118aa6 req-0fcdc262-6d63-4cac-8c38-0512fc216e51 service nova] Unable to find a host for instance ab2e7148-fa86-4648-9e4b-87e27fcf1147. Dropping event network-vif-unplugged {{(pid=117553) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 17:25:42.597125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-5c017555-d6b5-429f-8b56-d00747118aa6 req-0fcdc262-6d63-4cac-8c38-0512fc216e51 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042836 Jun 16 17:25:42.597997 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 187/374] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 16 17:25:42.783742 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8f3c41ef-9e0a-453d-85c2-c1a84d4e7c38 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "POST /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.577055 Jun 16 17:25:42.805122 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 188/375] 10.222.0.66 () {62 vars in 1363 bytes} [Thu Jun 16 17:25:42 2022] POST /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/os-volume_attachments => generated 188 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:25:42.928101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-18d48f3c-9886-4f0c-b29c-582e6717db3c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:25:42.928629 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-18d48f3c-9886-4f0c-b29c-582e6717db3c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:42.936318 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-18d48f3c-9886-4f0c-b29c-582e6717db3c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:42.937070 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-18d48f3c-9886-4f0c-b29c-582e6717db3c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:42.937923 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-18d48f3c-9886-4f0c-b29c-582e6717db3c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:42.938356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-18d48f3c-9886-4f0c-b29c-582e6717db3c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:43.117440 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-18d48f3c-9886-4f0c-b29c-582e6717db3c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "POST /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/action" status: 202 len: 0 microversion: 2.20 time: 0.192381 Jun 16 17:25:43.128538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-926f7193-2dab-4fd0-9f3d-84f8831b18e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:43.129529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-926f7193-2dab-4fd0-9f3d-84f8831b18e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:43.134508 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 188/376] 10.222.0.66 () {62 vars in 1318 bytes} [Thu Jun 16 17:25:42 2022] POST /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:25:43.138681 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-926f7193-2dab-4fd0-9f3d-84f8831b18e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:43.139218 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-926f7193-2dab-4fd0-9f3d-84f8831b18e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:43.140853 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-926f7193-2dab-4fd0-9f3d-84f8831b18e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:43.141497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-926f7193-2dab-4fd0-9f3d-84f8831b18e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:43.419531 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-926f7193-2dab-4fd0-9f3d-84f8831b18e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:43.433621 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-926f7193-2dab-4fd0-9f3d-84f8831b18e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:43.436275 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-926f7193-2dab-4fd0-9f3d-84f8831b18e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:43.437837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-926f7193-2dab-4fd0-9f3d-84f8831b18e8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1748 microversion: 2.20 time: 0.314042 Jun 16 17:25:43.438945 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 189/377] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:43 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1748 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:44.467564 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d8cb9907-dbe7-4ae6-b5a5-22ccd691cfb3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:44.468167 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-d8cb9907-dbe7-4ae6-b5a5-22ccd691cfb3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:44.489905 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d8cb9907-dbe7-4ae6-b5a5-22ccd691cfb3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:44.490707 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d8cb9907-dbe7-4ae6-b5a5-22ccd691cfb3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:44.491849 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d8cb9907-dbe7-4ae6-b5a5-22ccd691cfb3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:44.494196 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d8cb9907-dbe7-4ae6-b5a5-22ccd691cfb3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:45.021744 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d8cb9907-dbe7-4ae6-b5a5-22ccd691cfb3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:45.032439 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d8cb9907-dbe7-4ae6-b5a5-22ccd691cfb3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:45.034089 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d8cb9907-dbe7-4ae6-b5a5-22ccd691cfb3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:45.035535 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-d8cb9907-dbe7-4ae6-b5a5-22ccd691cfb3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1748 microversion: 2.20 time: 0.572508 Jun 16 17:25:45.036733 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 189/378] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:44 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1748 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:45.979054 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8b6ac828-8b54-4fa3-834a-3a70fff42350 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Action: 'create', calling method: .version_select at 0x7f66b17e2c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-345635134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmXEYgU/BOvklDRn6qQXA59573e2Vq39Y7o8JSqoUNoUV2GfpwJd5gsXK8kQwNS63OoixNr5oRQT3PUkSxSoY8Rwq6Xk7Yyicam6YCbNsXhkUGL/Pvh8E1k/EawBaqOOA=="}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:25:45.996371 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-8b6ac828-8b54-4fa3-834a-3a70fff42350 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Getting quotas for project 546929b1810a4d20b273f3e5492ec6ed. Resources: {'key_pairs'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:25:46.000688 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-8b6ac828-8b54-4fa3-834a-3a70fff42350 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Getting quotas for user 71df16d1e792468585702fd688b8d3f2 and project 546929b1810a4d20b273f3e5492ec6ed. Resources: {'key_pairs'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:25:46.027356 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8b6ac828-8b54-4fa3-834a-3a70fff42350 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053070 Jun 16 17:25:46.028223 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 190/379] 10.222.0.66 () {60 vars in 1158 bytes} [Thu Jun 16 17:25:45 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:25:46.063638 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-bed75469-22fc-4727-942e-26b8e0ae184e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:46.065328 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-bed75469-22fc-4727-942e-26b8e0ae184e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:46.077339 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bed75469-22fc-4727-942e-26b8e0ae184e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:46.078090 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bed75469-22fc-4727-942e-26b8e0ae184e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:46.079486 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bed75469-22fc-4727-942e-26b8e0ae184e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:46.079985 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bed75469-22fc-4727-942e-26b8e0ae184e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:46.184928 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-bb09e6e8-8446-4550-ad1a-dbf49b039f95 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1080904537", "imageRef": "107566c1-da86-4cc0-ad26-8d83b6f7979c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-345635134", "networks": [{"uuid": "35603100-8685-44dd-88ce-ba2913489196"}]}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:25:46.267709 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-bed75469-22fc-4727-942e-26b8e0ae184e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:46.271138 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.network.neutron [None req-bb09e6e8-8446-4550-ad1a-dbf49b039f95 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] validate_networks() for [('35603100-8685-44dd-88ce-ba2913489196', None, None, None, None, None)] {{(pid=117552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:25:46.279339 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-bed75469-22fc-4727-942e-26b8e0ae184e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:46.280815 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-bed75469-22fc-4727-942e-26b8e0ae184e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:46.282398 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-bed75469-22fc-4727-942e-26b8e0ae184e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1748 microversion: 2.20 time: 0.224168 Jun 16 17:25:46.282955 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 190/380] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:46 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1748 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:46.713363 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-bb09e6e8-8446-4550-ad1a-dbf49b039f95 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Flavor limits 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:25:46.713774 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-bb09e6e8-8446-4550-ad1a-dbf49b039f95 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Image limits 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:25:46.714242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-bb09e6e8-8446-4550-ad1a-dbf49b039f95 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Flavor pref 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:25:46.714645 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-bb09e6e8-8446-4550-ad1a-dbf49b039f95 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Image pref 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:25:46.715050 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-bb09e6e8-8446-4550-ad1a-dbf49b039f95 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:25:46.724964 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bb09e6e8-8446-4550-ad1a-dbf49b039f95 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:46.725311 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bb09e6e8-8446-4550-ad1a-dbf49b039f95 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:46.726139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bb09e6e8-8446-4550-ad1a-dbf49b039f95 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:46.726586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bb09e6e8-8446-4550-ad1a-dbf49b039f95 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:46.732993 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:46.752071 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-bb09e6e8-8446-4550-ad1a-dbf49b039f95 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Getting quotas for project 546929b1810a4d20b273f3e5492ec6ed. Resources: {'cores', 'instances', 'ram'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:25:46.756430 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-bb09e6e8-8446-4550-ad1a-dbf49b039f95 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Getting quotas for user 71df16d1e792468585702fd688b8d3f2 and project 546929b1810a4d20b273f3e5492ec6ed. Resources: {'cores', 'instances', 'ram'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:25:46.768487 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-bb09e6e8-8446-4550-ad1a-dbf49b039f95 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Going to run 1 instances... {{(pid=117552) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:25:46.771414 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-bb09e6e8-8446-4550-ad1a-dbf49b039f95 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='107566c1-da86-4cc0-ad26-8d83b6f7979c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:25:46.833521 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-bb09e6e8-8446-4550-ad1a-dbf49b039f95 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652653 Jun 16 17:25:46.834866 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 191/381] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:25:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:25:46.847416 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b69dd4c8-8489-4c13-82e0-c0d3da5219ce tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:46.848920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-b69dd4c8-8489-4c13-82e0-c0d3da5219ce tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:46.920193 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b69dd4c8-8489-4c13-82e0-c0d3da5219ce tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:46.927496 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b69dd4c8-8489-4c13-82e0-c0d3da5219ce tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1258 microversion: 2.1 time: 0.085060 Jun 16 17:25:46.928384 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 191/382] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:46 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1258 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:47.302148 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-06b0303b-3d0d-45fb-aff2-53483b993e74 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:47.302771 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-06b0303b-3d0d-45fb-aff2-53483b993e74 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:47.323832 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-06b0303b-3d0d-45fb-aff2-53483b993e74 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:47.324252 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-06b0303b-3d0d-45fb-aff2-53483b993e74 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:47.326371 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-06b0303b-3d0d-45fb-aff2-53483b993e74 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:47.326809 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-06b0303b-3d0d-45fb-aff2-53483b993e74 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:47.488152 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-06b0303b-3d0d-45fb-aff2-53483b993e74 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:47.497905 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-06b0303b-3d0d-45fb-aff2-53483b993e74 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:47.499391 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-06b0303b-3d0d-45fb-aff2-53483b993e74 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:47.500563 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-06b0303b-3d0d-45fb-aff2-53483b993e74 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1750 microversion: 2.20 time: 0.202927 Jun 16 17:25:47.501319 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 192/383] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:47 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1750 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:47.946561 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-388a89cb-5c66-4c59-8ae2-aa9dbbf19243 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:47.947131 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-388a89cb-5c66-4c59-8ae2-aa9dbbf19243 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:47.954925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-388a89cb-5c66-4c59-8ae2-aa9dbbf19243 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:47.955404 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-388a89cb-5c66-4c59-8ae2-aa9dbbf19243 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:47.956202 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-388a89cb-5c66-4c59-8ae2-aa9dbbf19243 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:47.956664 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-388a89cb-5c66-4c59-8ae2-aa9dbbf19243 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:48.022378 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-388a89cb-5c66-4c59-8ae2-aa9dbbf19243 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:48.033438 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-388a89cb-5c66-4c59-8ae2-aa9dbbf19243 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1310 microversion: 2.1 time: 0.090811 Jun 16 17:25:48.034283 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 192/384] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:47 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1310 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:48.521216 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-79805b7b-23e1-4227-b601-cb9d97051091 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:48.521826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-79805b7b-23e1-4227-b601-cb9d97051091 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:48.530724 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-79805b7b-23e1-4227-b601-cb9d97051091 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:48.531807 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-79805b7b-23e1-4227-b601-cb9d97051091 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:48.532842 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-79805b7b-23e1-4227-b601-cb9d97051091 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:48.533440 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-79805b7b-23e1-4227-b601-cb9d97051091 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:48.703437 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-79805b7b-23e1-4227-b601-cb9d97051091 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:48.714515 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-79805b7b-23e1-4227-b601-cb9d97051091 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:48.715991 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-79805b7b-23e1-4227-b601-cb9d97051091 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:48.717137 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-79805b7b-23e1-4227-b601-cb9d97051091 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1750 microversion: 2.20 time: 0.200464 Jun 16 17:25:48.717704 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 193/385] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:48 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1750 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:49.056876 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-9baa70b3-37f3-45c8-8b5f-75ecbc9aab1f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:49.058562 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-9baa70b3-37f3-45c8-8b5f-75ecbc9aab1f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:49.065893 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9baa70b3-37f3-45c8-8b5f-75ecbc9aab1f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:49.066385 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9baa70b3-37f3-45c8-8b5f-75ecbc9aab1f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:49.067154 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9baa70b3-37f3-45c8-8b5f-75ecbc9aab1f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:49.067585 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9baa70b3-37f3-45c8-8b5f-75ecbc9aab1f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:49.183137 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-9baa70b3-37f3-45c8-8b5f-75ecbc9aab1f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:49.204737 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-9baa70b3-37f3-45c8-8b5f-75ecbc9aab1f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1316 microversion: 2.1 time: 0.152318 Jun 16 17:25:49.205398 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 193/386] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:49 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:49.737218 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9b4c593e-3fa5-421a-b797-86323b752b62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:49.737891 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-9b4c593e-3fa5-421a-b797-86323b752b62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:49.763948 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9b4c593e-3fa5-421a-b797-86323b752b62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:49.764481 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9b4c593e-3fa5-421a-b797-86323b752b62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:49.766102 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9b4c593e-3fa5-421a-b797-86323b752b62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:49.766959 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9b4c593e-3fa5-421a-b797-86323b752b62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:50.033197 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9b4c593e-3fa5-421a-b797-86323b752b62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:50.048451 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9b4c593e-3fa5-421a-b797-86323b752b62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:50.053345 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9b4c593e-3fa5-421a-b797-86323b752b62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:50.067231 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9b4c593e-3fa5-421a-b797-86323b752b62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1750 microversion: 2.20 time: 0.335169 Jun 16 17:25:50.071906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 194/387] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:49 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1750 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:50.223203 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-6a947f89-8abf-4559-ad8e-04cacaf2b9f8 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:50.223864 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-6a947f89-8abf-4559-ad8e-04cacaf2b9f8 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:50.231697 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6a947f89-8abf-4559-ad8e-04cacaf2b9f8 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:50.232382 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6a947f89-8abf-4559-ad8e-04cacaf2b9f8 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:50.233414 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6a947f89-8abf-4559-ad8e-04cacaf2b9f8 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:50.234298 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6a947f89-8abf-4559-ad8e-04cacaf2b9f8 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:50.451204 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6a947f89-8abf-4559-ad8e-04cacaf2b9f8 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:50.459355 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-6a947f89-8abf-4559-ad8e-04cacaf2b9f8 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.240023 Jun 16 17:25:50.459917 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 194/388] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:50 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:25:51.091565 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d9961928-6c34-4df9-9e9e-c566cb577625 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:51.092890 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d9961928-6c34-4df9-9e9e-c566cb577625 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:51.102042 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d9961928-6c34-4df9-9e9e-c566cb577625 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:51.102805 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d9961928-6c34-4df9-9e9e-c566cb577625 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:51.103836 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d9961928-6c34-4df9-9e9e-c566cb577625 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:51.105967 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d9961928-6c34-4df9-9e9e-c566cb577625 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:51.295393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d9961928-6c34-4df9-9e9e-c566cb577625 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:51.311327 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d9961928-6c34-4df9-9e9e-c566cb577625 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:51.313317 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d9961928-6c34-4df9-9e9e-c566cb577625 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:51.314709 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d9961928-6c34-4df9-9e9e-c566cb577625 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1750 microversion: 2.20 time: 0.228915 Jun 16 17:25:51.315609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 195/389] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:51 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1750 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:51.477013 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b568c5cc-b365-47f0-b138-6c7fde818fee tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:51.477582 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-b568c5cc-b365-47f0-b138-6c7fde818fee tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:51.485403 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b568c5cc-b365-47f0-b138-6c7fde818fee tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:51.486352 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b568c5cc-b365-47f0-b138-6c7fde818fee tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:51.487219 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b568c5cc-b365-47f0-b138-6c7fde818fee tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:51.487730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b568c5cc-b365-47f0-b138-6c7fde818fee tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:51.635741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b568c5cc-b365-47f0-b138-6c7fde818fee tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:51.644103 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b568c5cc-b365-47f0-b138-6c7fde818fee tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.171809 Jun 16 17:25:51.644691 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 195/390] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:51 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:52.335515 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8867afb7-7ceb-4437-a5a2-0e37022bda27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:52.337436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8867afb7-7ceb-4437-a5a2-0e37022bda27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:52.345617 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8867afb7-7ceb-4437-a5a2-0e37022bda27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:52.346752 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8867afb7-7ceb-4437-a5a2-0e37022bda27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:52.348083 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8867afb7-7ceb-4437-a5a2-0e37022bda27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:52.348580 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8867afb7-7ceb-4437-a5a2-0e37022bda27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:52.548915 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8867afb7-7ceb-4437-a5a2-0e37022bda27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:52.561144 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8867afb7-7ceb-4437-a5a2-0e37022bda27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:52.563968 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8867afb7-7ceb-4437-a5a2-0e37022bda27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:52.565827 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8867afb7-7ceb-4437-a5a2-0e37022bda27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1750 microversion: 2.20 time: 0.234632 Jun 16 17:25:52.567088 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 196/391] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:52 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1750 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:52.661771 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5a8ab21e-ab92-4206-8c27-be1b3523d29f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:52.663195 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5a8ab21e-ab92-4206-8c27-be1b3523d29f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:52.670773 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5a8ab21e-ab92-4206-8c27-be1b3523d29f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:52.679031 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5a8ab21e-ab92-4206-8c27-be1b3523d29f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:52.680783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5a8ab21e-ab92-4206-8c27-be1b3523d29f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:52.681410 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5a8ab21e-ab92-4206-8c27-be1b3523d29f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:52.851055 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-5a8ab21e-ab92-4206-8c27-be1b3523d29f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:52.859297 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5a8ab21e-ab92-4206-8c27-be1b3523d29f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.200887 Jun 16 17:25:52.859541 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 196/392] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:52 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:53.585459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-79e1cd55-ab7d-466c-9695-e677d60f8523 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:53.586777 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-79e1cd55-ab7d-466c-9695-e677d60f8523 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:53.594307 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-79e1cd55-ab7d-466c-9695-e677d60f8523 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:53.594755 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-79e1cd55-ab7d-466c-9695-e677d60f8523 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:53.595539 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-79e1cd55-ab7d-466c-9695-e677d60f8523 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:53.596002 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-79e1cd55-ab7d-466c-9695-e677d60f8523 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:53.741235 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-79e1cd55-ab7d-466c-9695-e677d60f8523 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:53.750357 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-79e1cd55-ab7d-466c-9695-e677d60f8523 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:53.751840 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-79e1cd55-ab7d-466c-9695-e677d60f8523 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:53.753031 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-79e1cd55-ab7d-466c-9695-e677d60f8523 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1750 microversion: 2.20 time: 0.171746 Jun 16 17:25:53.753615 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 197/393] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:53 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:53.876510 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-bd337b6e-4d4c-459e-a532-d62f98e052c7 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:53.877447 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-bd337b6e-4d4c-459e-a532-d62f98e052c7 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:53.886494 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bd337b6e-4d4c-459e-a532-d62f98e052c7 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:53.887184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bd337b6e-4d4c-459e-a532-d62f98e052c7 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:53.888368 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bd337b6e-4d4c-459e-a532-d62f98e052c7 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:53.889027 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bd337b6e-4d4c-459e-a532-d62f98e052c7 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:54.044660 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-bd337b6e-4d4c-459e-a532-d62f98e052c7 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:54.057762 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-bd337b6e-4d4c-459e-a532-d62f98e052c7 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.184950 Jun 16 17:25:54.067828 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 197/394] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:53 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:54.775120 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ebc8038b-db60-45fe-a6de-6855334a793a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:54.775710 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ebc8038b-db60-45fe-a6de-6855334a793a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:54.783695 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ebc8038b-db60-45fe-a6de-6855334a793a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:54.784139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ebc8038b-db60-45fe-a6de-6855334a793a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:54.784928 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ebc8038b-db60-45fe-a6de-6855334a793a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:54.785394 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ebc8038b-db60-45fe-a6de-6855334a793a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:54.963138 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ebc8038b-db60-45fe-a6de-6855334a793a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:54.984368 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ebc8038b-db60-45fe-a6de-6855334a793a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:54.985876 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ebc8038b-db60-45fe-a6de-6855334a793a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:54.987735 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ebc8038b-db60-45fe-a6de-6855334a793a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1750 microversion: 2.20 time: 0.217105 Jun 16 17:25:54.988303 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 198/395] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:54 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1750 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:25:55.080055 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b3e63e0b-e571-4579-88ef-8b3f4c8fbcb9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:55.080731 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-b3e63e0b-e571-4579-88ef-8b3f4c8fbcb9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:55.090778 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b3e63e0b-e571-4579-88ef-8b3f4c8fbcb9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:55.091290 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b3e63e0b-e571-4579-88ef-8b3f4c8fbcb9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:55.092002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b3e63e0b-e571-4579-88ef-8b3f4c8fbcb9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:55.093031 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b3e63e0b-e571-4579-88ef-8b3f4c8fbcb9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:55.542540 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b3e63e0b-e571-4579-88ef-8b3f4c8fbcb9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:55.552613 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b3e63e0b-e571-4579-88ef-8b3f4c8fbcb9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.478276 Jun 16 17:25:55.560314 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 198/396] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:55 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:55.953752 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-554b60de-b7de-4bd3-878c-343cfd4add37 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c56cbab9-9648-4d55-8c9a-e973c96b8ea4"}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:25:55.955015 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-554b60de-b7de-4bd3-878c-343cfd4add37 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:55.962373 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-554b60de-b7de-4bd3-878c-343cfd4add37 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:55.962823 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-554b60de-b7de-4bd3-878c-343cfd4add37 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:55.963724 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-554b60de-b7de-4bd3-878c-343cfd4add37 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:55.964161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-554b60de-b7de-4bd3-878c-343cfd4add37 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:56.022789 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-876aa981-7a79-4346-a280-34157106ab5c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:56.023527 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-876aa981-7a79-4346-a280-34157106ab5c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:56.030334 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-876aa981-7a79-4346-a280-34157106ab5c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:56.030929 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-876aa981-7a79-4346-a280-34157106ab5c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:56.031642 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-876aa981-7a79-4346-a280-34157106ab5c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:56.031949 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-876aa981-7a79-4346-a280-34157106ab5c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:56.259043 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-876aa981-7a79-4346-a280-34157106ab5c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:56.270686 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-876aa981-7a79-4346-a280-34157106ab5c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:56.272167 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-876aa981-7a79-4346-a280-34157106ab5c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:56.273737 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-876aa981-7a79-4346-a280-34157106ab5c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1750 microversion: 2.20 time: 0.258562 Jun 16 17:25:56.274032 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 199/397] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:56 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1750 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:25:56.579854 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-e8d22824-017f-4425-a393-3194ab9053e9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:56.580557 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-e8d22824-017f-4425-a393-3194ab9053e9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:56.588061 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e8d22824-017f-4425-a393-3194ab9053e9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:56.588596 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e8d22824-017f-4425-a393-3194ab9053e9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:56.589473 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e8d22824-017f-4425-a393-3194ab9053e9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:56.589974 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e8d22824-017f-4425-a393-3194ab9053e9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:56.744712 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:56.763901 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=14 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:56.786388 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e8d22824-017f-4425-a393-3194ab9053e9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:56.795457 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-e8d22824-017f-4425-a393-3194ab9053e9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.219503 Jun 16 17:25:56.796030 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 200/398] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:56 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:57.292795 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-80b55f63-fdd6-4bbb-9cae-1c168a29fff5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:57.293587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-80b55f63-fdd6-4bbb-9cae-1c168a29fff5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:57.295592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:57.302799 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-80b55f63-fdd6-4bbb-9cae-1c168a29fff5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:57.308715 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-80b55f63-fdd6-4bbb-9cae-1c168a29fff5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:57.312779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-80b55f63-fdd6-4bbb-9cae-1c168a29fff5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:57.313381 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-80b55f63-fdd6-4bbb-9cae-1c168a29fff5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:57.475777 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-80b55f63-fdd6-4bbb-9cae-1c168a29fff5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:57.487819 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-80b55f63-fdd6-4bbb-9cae-1c168a29fff5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:57.489984 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-80b55f63-fdd6-4bbb-9cae-1c168a29fff5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:57.491403 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-80b55f63-fdd6-4bbb-9cae-1c168a29fff5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1750 microversion: 2.20 time: 0.202837 Jun 16 17:25:57.492666 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 201/399] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:57 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1750 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:25:57.813664 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-e7d868d9-4123-4667-addd-9286e26df04c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:57.814475 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-e7d868d9-4123-4667-addd-9286e26df04c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:57.822971 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e7d868d9-4123-4667-addd-9286e26df04c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:57.823430 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e7d868d9-4123-4667-addd-9286e26df04c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:57.824471 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e7d868d9-4123-4667-addd-9286e26df04c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:57.824964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e7d868d9-4123-4667-addd-9286e26df04c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:57.967796 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e7d868d9-4123-4667-addd-9286e26df04c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:57.980120 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-e7d868d9-4123-4667-addd-9286e26df04c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.171198 Jun 16 17:25:57.981265 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 202/400] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:57 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:25:58.509837 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-04d8d4e9-612c-4156-91af-7e4caf74a3b1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:58.510574 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-04d8d4e9-612c-4156-91af-7e4caf74a3b1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:58.529675 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-04d8d4e9-612c-4156-91af-7e4caf74a3b1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:58.529675 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-04d8d4e9-612c-4156-91af-7e4caf74a3b1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:58.529675 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-04d8d4e9-612c-4156-91af-7e4caf74a3b1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:58.529675 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-04d8d4e9-612c-4156-91af-7e4caf74a3b1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:58.546229 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:58.679632 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-04d8d4e9-612c-4156-91af-7e4caf74a3b1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:58.688769 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-04d8d4e9-612c-4156-91af-7e4caf74a3b1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:58.690330 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-04d8d4e9-612c-4156-91af-7e4caf74a3b1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:58.691535 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-04d8d4e9-612c-4156-91af-7e4caf74a3b1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1750 microversion: 2.20 time: 0.185730 Jun 16 17:25:58.692365 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 203/401] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:58 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1750 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:25:58.999982 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f54b598f-ae22-4f47-8a32-be4a3dc8805b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:59.000664 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f54b598f-ae22-4f47-8a32-be4a3dc8805b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:59.008829 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f54b598f-ae22-4f47-8a32-be4a3dc8805b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:59.009543 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f54b598f-ae22-4f47-8a32-be4a3dc8805b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:59.010484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f54b598f-ae22-4f47-8a32-be4a3dc8805b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:59.011089 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f54b598f-ae22-4f47-8a32-be4a3dc8805b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:59.159757 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-f54b598f-ae22-4f47-8a32-be4a3dc8805b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:59.169565 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f54b598f-ae22-4f47-8a32-be4a3dc8805b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.174443 Jun 16 17:25:59.170232 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 204/402] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:25:58 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:25:59.710157 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2b9f4b3b-c2df-4155-8c02-041fad636e62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:59.711073 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2b9f4b3b-c2df-4155-8c02-041fad636e62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:25:59.713502 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=52 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:59.720105 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2b9f4b3b-c2df-4155-8c02-041fad636e62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:59.720673 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2b9f4b3b-c2df-4155-8c02-041fad636e62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:59.721947 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2b9f4b3b-c2df-4155-8c02-041fad636e62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:59.722582 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2b9f4b3b-c2df-4155-8c02-041fad636e62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:59.877766 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2b9f4b3b-c2df-4155-8c02-041fad636e62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:59.887700 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2b9f4b3b-c2df-4155-8c02-041fad636e62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:59.890276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2b9f4b3b-c2df-4155-8c02-041fad636e62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:25:59.891945 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2b9f4b3b-c2df-4155-8c02-041fad636e62 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1750 microversion: 2.20 time: 0.185544 Jun 16 17:25:59.892780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 205/403] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:25:59 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1750 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:00.193125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7116c046-e6ed-4b35-b831-d80339664a69 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:00.193737 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-7116c046-e6ed-4b35-b831-d80339664a69 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:00.202052 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7116c046-e6ed-4b35-b831-d80339664a69 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:00.202798 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7116c046-e6ed-4b35-b831-d80339664a69 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:00.204219 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7116c046-e6ed-4b35-b831-d80339664a69 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:00.205071 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7116c046-e6ed-4b35-b831-d80339664a69 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:00.206115 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-554b60de-b7de-4bd3-878c-343cfd4add37 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "POST /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.256413 Jun 16 17:26:00.207168 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 199/404] 10.222.0.66 () {60 vars in 1322 bytes} [Thu Jun 16 17:25:55 2022] POST /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/os-volume_attachments => generated 194 bytes in 4258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:26:00.413061 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7116c046-e6ed-4b35-b831-d80339664a69 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:00.428503 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7116c046-e6ed-4b35-b831-d80339664a69 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.243333 Jun 16 17:26:00.431080 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 206/405] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:00 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:00.792490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-848b8766-ec8b-4fe1-9e9b-af9c07c85cb0 req-e799d8a6-6527-43cd-81d1-7b7783e2d2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ee9b10-f2da-442c-9475-3cfb21c9ad54", "tag": "676f9af5-715a-4f80-b6f8-747296e84e2c"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:00.804299 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-848b8766-ec8b-4fe1-9e9b-af9c07c85cb0 req-e799d8a6-6527-43cd-81d1-7b7783e2d2f6 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:00.805034 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-848b8766-ec8b-4fe1-9e9b-af9c07c85cb0 req-e799d8a6-6527-43cd-81d1-7b7783e2d2f6 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:00.821601 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-848b8766-ec8b-4fe1-9e9b-af9c07c85cb0 req-e799d8a6-6527-43cd-81d1-7b7783e2d2f6 service nova] Creating event network-changed:676f9af5-715a-4f80-b6f8-747296e84e2c for instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 on hv-cinder-83735 Jun 16 17:26:00.827377 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-848b8766-ec8b-4fe1-9e9b-af9c07c85cb0 req-e799d8a6-6527-43cd-81d1-7b7783e2d2f6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042053 Jun 16 17:26:00.828166 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 200/406] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:26:00.911748 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-0d840539-fe89-4f87-b8ae-15a94cc05259 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:00.912468 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-0d840539-fe89-4f87-b8ae-15a94cc05259 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:00.921044 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0d840539-fe89-4f87-b8ae-15a94cc05259 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:00.921589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0d840539-fe89-4f87-b8ae-15a94cc05259 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:00.922363 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0d840539-fe89-4f87-b8ae-15a94cc05259 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:00.922799 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0d840539-fe89-4f87-b8ae-15a94cc05259 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:01.106096 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0d840539-fe89-4f87-b8ae-15a94cc05259 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:01.117958 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0d840539-fe89-4f87-b8ae-15a94cc05259 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:01.120293 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0d840539-fe89-4f87-b8ae-15a94cc05259 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:01.121637 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-0d840539-fe89-4f87-b8ae-15a94cc05259 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.213953 Jun 16 17:26:01.122740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 207/407] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:00 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:01.450575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-895d1bfa-8e99-4ce4-a567-38d16bb66d08 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:01.451578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-895d1bfa-8e99-4ce4-a567-38d16bb66d08 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:01.470843 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-895d1bfa-8e99-4ce4-a567-38d16bb66d08 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:01.471405 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-895d1bfa-8e99-4ce4-a567-38d16bb66d08 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:01.472328 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-895d1bfa-8e99-4ce4-a567-38d16bb66d08 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:01.472768 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-895d1bfa-8e99-4ce4-a567-38d16bb66d08 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:01.669294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-895d1bfa-8e99-4ce4-a567-38d16bb66d08 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:01.678247 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-895d1bfa-8e99-4ce4-a567-38d16bb66d08 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.233255 Jun 16 17:26:01.679083 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 201/408] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:01 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:02.142878 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-e101bb1f-1aab-4ab7-a360-26f24a20d955 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:02.143880 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-e101bb1f-1aab-4ab7-a360-26f24a20d955 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:02.151947 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e101bb1f-1aab-4ab7-a360-26f24a20d955 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:02.152458 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e101bb1f-1aab-4ab7-a360-26f24a20d955 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:02.153300 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e101bb1f-1aab-4ab7-a360-26f24a20d955 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:02.153734 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e101bb1f-1aab-4ab7-a360-26f24a20d955 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:02.304267 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e101bb1f-1aab-4ab7-a360-26f24a20d955 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:02.316012 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e101bb1f-1aab-4ab7-a360-26f24a20d955 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:02.317593 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e101bb1f-1aab-4ab7-a360-26f24a20d955 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:02.318954 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-e101bb1f-1aab-4ab7-a360-26f24a20d955 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.180224 Jun 16 17:26:02.319734 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 208/409] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:02 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:02.696359 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-fcad064d-d623-4026-be59-81aba127c6ec tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:02.697809 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-fcad064d-d623-4026-be59-81aba127c6ec tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:02.705520 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fcad064d-d623-4026-be59-81aba127c6ec tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:02.705990 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fcad064d-d623-4026-be59-81aba127c6ec tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:02.706742 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fcad064d-d623-4026-be59-81aba127c6ec tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:02.707189 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fcad064d-d623-4026-be59-81aba127c6ec tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:02.855391 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-fcad064d-d623-4026-be59-81aba127c6ec tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:02.867603 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-fcad064d-d623-4026-be59-81aba127c6ec tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.175339 Jun 16 17:26:02.868196 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 202/410] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:02 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:03.340005 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ebd7e8fb-6629-488c-9281-5fdd97d54ea3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:03.340587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ebd7e8fb-6629-488c-9281-5fdd97d54ea3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:03.347753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ebd7e8fb-6629-488c-9281-5fdd97d54ea3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:03.348112 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ebd7e8fb-6629-488c-9281-5fdd97d54ea3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:03.348861 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ebd7e8fb-6629-488c-9281-5fdd97d54ea3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:03.349360 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ebd7e8fb-6629-488c-9281-5fdd97d54ea3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:03.503246 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ebd7e8fb-6629-488c-9281-5fdd97d54ea3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:03.512846 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ebd7e8fb-6629-488c-9281-5fdd97d54ea3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:03.514394 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ebd7e8fb-6629-488c-9281-5fdd97d54ea3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:03.515980 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ebd7e8fb-6629-488c-9281-5fdd97d54ea3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.179724 Jun 16 17:26:03.520104 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 209/411] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:03 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:03.885319 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-cc8f8253-35d8-4519-825f-6cd85cf2fbc9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:03.885929 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-cc8f8253-35d8-4519-825f-6cd85cf2fbc9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:03.892867 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cc8f8253-35d8-4519-825f-6cd85cf2fbc9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:03.893355 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cc8f8253-35d8-4519-825f-6cd85cf2fbc9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:03.894116 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cc8f8253-35d8-4519-825f-6cd85cf2fbc9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:03.894547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cc8f8253-35d8-4519-825f-6cd85cf2fbc9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:04.027107 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-cc8f8253-35d8-4519-825f-6cd85cf2fbc9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:04.035287 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-cc8f8253-35d8-4519-825f-6cd85cf2fbc9 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.154103 Jun 16 17:26:04.035849 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 203/412] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:03 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:04.549985 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-876399c6-a781-4880-a64f-5cc9b10231ef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:04.550658 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-876399c6-a781-4880-a64f-5cc9b10231ef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:04.557203 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-876399c6-a781-4880-a64f-5cc9b10231ef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:04.557728 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-876399c6-a781-4880-a64f-5cc9b10231ef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:04.558555 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-876399c6-a781-4880-a64f-5cc9b10231ef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:04.559050 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-876399c6-a781-4880-a64f-5cc9b10231ef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:04.707579 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-876399c6-a781-4880-a64f-5cc9b10231ef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:04.717197 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-876399c6-a781-4880-a64f-5cc9b10231ef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:04.718711 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-876399c6-a781-4880-a64f-5cc9b10231ef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:04.719876 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-876399c6-a781-4880-a64f-5cc9b10231ef tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.174388 Jun 16 17:26:04.720411 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 210/413] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:04 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:05.052611 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c79327c8-05f9-4929-a5cd-5d71fe74f3bc tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:05.053322 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c79327c8-05f9-4929-a5cd-5d71fe74f3bc tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:05.061869 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c79327c8-05f9-4929-a5cd-5d71fe74f3bc tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:05.062316 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c79327c8-05f9-4929-a5cd-5d71fe74f3bc tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:05.063112 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c79327c8-05f9-4929-a5cd-5d71fe74f3bc tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:05.063541 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c79327c8-05f9-4929-a5cd-5d71fe74f3bc tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:05.212547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c79327c8-05f9-4929-a5cd-5d71fe74f3bc tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:05.223580 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c79327c8-05f9-4929-a5cd-5d71fe74f3bc tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.174784 Jun 16 17:26:05.224264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 204/414] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:05 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:05.739337 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-14bae0bb-8015-42a8-bf44-b34b5e549fe4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:05.739936 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-14bae0bb-8015-42a8-bf44-b34b5e549fe4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:05.748254 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-14bae0bb-8015-42a8-bf44-b34b5e549fe4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:05.748790 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-14bae0bb-8015-42a8-bf44-b34b5e549fe4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:05.750173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-14bae0bb-8015-42a8-bf44-b34b5e549fe4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:05.750770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-14bae0bb-8015-42a8-bf44-b34b5e549fe4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:05.896157 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-14bae0bb-8015-42a8-bf44-b34b5e549fe4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:05.906587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-14bae0bb-8015-42a8-bf44-b34b5e549fe4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:05.908204 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-14bae0bb-8015-42a8-bf44-b34b5e549fe4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:05.909695 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-14bae0bb-8015-42a8-bf44-b34b5e549fe4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.174258 Jun 16 17:26:05.910717 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 211/415] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:05 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:06.001740 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-06a240a1-8f55-4146-a732-a8785f789ba3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1855877222", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2110136853", "security_groups": [{"name": "tempest-secgroup-smoke-641343783"}], "block_device_mapping_v2": [{"uuid": "a0b4308e-b64d-4831-88b8-b801d3610548", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3da1c24e-a853-4091-89c9-dc663f379476"}]}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:06.134513 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.network.neutron [None req-06a240a1-8f55-4146-a732-a8785f789ba3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] validate_networks() for [('3da1c24e-a853-4091-89c9-dc663f379476', None, None, None, None, None)] {{(pid=117552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:26:06.240467 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7b63f689-27cf-4e36-89b3-671e3a3124c8 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:06.242287 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-7b63f689-27cf-4e36-89b3-671e3a3124c8 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:06.249022 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7b63f689-27cf-4e36-89b3-671e3a3124c8 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:06.250003 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7b63f689-27cf-4e36-89b3-671e3a3124c8 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:06.250890 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7b63f689-27cf-4e36-89b3-671e3a3124c8 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:06.251390 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7b63f689-27cf-4e36-89b3-671e3a3124c8 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:06.404111 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7b63f689-27cf-4e36-89b3-671e3a3124c8 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:06.412143 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7b63f689-27cf-4e36-89b3-671e3a3124c8 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.175521 Jun 16 17:26:06.412717 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 212/416] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:06 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:06.590918 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-06a240a1-8f55-4146-a732-a8785f789ba3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Flavor limits 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:26:06.591554 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-06a240a1-8f55-4146-a732-a8785f789ba3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Image limits 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:26:06.592270 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-06a240a1-8f55-4146-a732-a8785f789ba3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Flavor pref 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:26:06.592616 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-06a240a1-8f55-4146-a732-a8785f789ba3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Image pref 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:26:06.593029 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-06a240a1-8f55-4146-a732-a8785f789ba3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:26:06.606841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-06a240a1-8f55-4146-a732-a8785f789ba3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:06.607586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-06a240a1-8f55-4146-a732-a8785f789ba3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:06.609128 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-06a240a1-8f55-4146-a732-a8785f789ba3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:06.610010 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-06a240a1-8f55-4146-a732-a8785f789ba3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:06.634216 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-06a240a1-8f55-4146-a732-a8785f789ba3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Getting quotas for project bd1488226a424c6e9e7f94f31b020e4f. Resources: {'cores', 'instances', 'ram'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:26:06.648222 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-06a240a1-8f55-4146-a732-a8785f789ba3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Getting quotas for user fbbafeb56a4d4fd282275e4198ede783 and project bd1488226a424c6e9e7f94f31b020e4f. Resources: {'cores', 'instances', 'ram'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:26:06.780307 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-06a240a1-8f55-4146-a732-a8785f789ba3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Going to run 1 instances... {{(pid=117552) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:26:06.784623 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-06a240a1-8f55-4146-a732-a8785f789ba3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a0b4308e-b64d-4831-88b8-b801d3610548',volume_size=None,volume_type=None)] {{(pid=117552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:26:06.932805 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-be6b0f5f-dae5-4309-bb77-cef9e50205ff tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:06.933425 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-be6b0f5f-dae5-4309-bb77-cef9e50205ff tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:06.954717 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-be6b0f5f-dae5-4309-bb77-cef9e50205ff tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:06.958449 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-be6b0f5f-dae5-4309-bb77-cef9e50205ff tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:06.958581 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-be6b0f5f-dae5-4309-bb77-cef9e50205ff tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:06.958950 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-be6b0f5f-dae5-4309-bb77-cef9e50205ff tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:06.962688 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-06a240a1-8f55-4146-a732-a8785f789ba3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.964626 Jun 16 17:26:06.963947 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 205/417] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:26:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:26:06.988582 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-33f195da-2084-4207-99ad-0052f7dbc1cb tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:06.990360 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-33f195da-2084-4207-99ad-0052f7dbc1cb tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:07.122317 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-33f195da-2084-4207-99ad-0052f7dbc1cb tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:07.151295 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-33f195da-2084-4207-99ad-0052f7dbc1cb tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1095 microversion: 2.1 time: 0.181292 Jun 16 17:26:07.165303 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 206/418] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:06 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1095 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:07.284704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-be6b0f5f-dae5-4309-bb77-cef9e50205ff tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:07.296728 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-be6b0f5f-dae5-4309-bb77-cef9e50205ff tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:07.298348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-be6b0f5f-dae5-4309-bb77-cef9e50205ff tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:07.299731 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-be6b0f5f-dae5-4309-bb77-cef9e50205ff tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.371795 Jun 16 17:26:07.300288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 213/419] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:06 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:26:07.431891 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-1955ea7f-7398-46d4-a2e8-c3d5d2e43e10 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:07.432842 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-1955ea7f-7398-46d4-a2e8-c3d5d2e43e10 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:07.439637 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1955ea7f-7398-46d4-a2e8-c3d5d2e43e10 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:07.440353 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1955ea7f-7398-46d4-a2e8-c3d5d2e43e10 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:07.441370 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1955ea7f-7398-46d4-a2e8-c3d5d2e43e10 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:07.441955 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1955ea7f-7398-46d4-a2e8-c3d5d2e43e10 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:07.663896 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-1955ea7f-7398-46d4-a2e8-c3d5d2e43e10 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:07.674850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-1955ea7f-7398-46d4-a2e8-c3d5d2e43e10 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.248065 Jun 16 17:26:07.685607 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 207/420] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:07 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:08.171947 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f93abf70-ecb9-4552-b443-17d9aa98dc58 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:08.172683 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f93abf70-ecb9-4552-b443-17d9aa98dc58 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:08.183353 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f93abf70-ecb9-4552-b443-17d9aa98dc58 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:08.184257 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f93abf70-ecb9-4552-b443-17d9aa98dc58 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:08.185237 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f93abf70-ecb9-4552-b443-17d9aa98dc58 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:08.185808 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f93abf70-ecb9-4552-b443-17d9aa98dc58 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:08.253109 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-f93abf70-ecb9-4552-b443-17d9aa98dc58 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:08.261494 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f93abf70-ecb9-4552-b443-17d9aa98dc58 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1145 microversion: 2.1 time: 0.093345 Jun 16 17:26:08.262233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 214/421] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:08 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:08.319050 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a34680ce-196d-4ee2-a115-f8ebee24ebfe tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:08.319865 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a34680ce-196d-4ee2-a115-f8ebee24ebfe tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:08.327698 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a34680ce-196d-4ee2-a115-f8ebee24ebfe tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:08.328149 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a34680ce-196d-4ee2-a115-f8ebee24ebfe tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:08.328953 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a34680ce-196d-4ee2-a115-f8ebee24ebfe tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:08.329408 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a34680ce-196d-4ee2-a115-f8ebee24ebfe tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:08.482053 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a34680ce-196d-4ee2-a115-f8ebee24ebfe tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:08.493531 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a34680ce-196d-4ee2-a115-f8ebee24ebfe tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:08.494760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a34680ce-196d-4ee2-a115-f8ebee24ebfe tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:08.496190 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a34680ce-196d-4ee2-a115-f8ebee24ebfe tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.181090 Jun 16 17:26:08.496885 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 208/422] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:08 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:08.692862 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a806adf1-9639-42b6-b121-895dc71fb897 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:08.693792 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a806adf1-9639-42b6-b121-895dc71fb897 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:08.701847 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a806adf1-9639-42b6-b121-895dc71fb897 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:08.702895 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a806adf1-9639-42b6-b121-895dc71fb897 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:08.703812 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a806adf1-9639-42b6-b121-895dc71fb897 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:08.704234 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a806adf1-9639-42b6-b121-895dc71fb897 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:08.794555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-47cafd22-3565-476f-825b-aa81087f1e91 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:08.795056 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-47cafd22-3565-476f-825b-aa81087f1e91 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:08.803099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-47cafd22-3565-476f-825b-aa81087f1e91 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:08.803543 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-47cafd22-3565-476f-825b-aa81087f1e91 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:08.804843 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-47cafd22-3565-476f-825b-aa81087f1e91 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:08.805395 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-47cafd22-3565-476f-825b-aa81087f1e91 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:08.876223 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:08.893541 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a806adf1-9639-42b6-b121-895dc71fb897 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:08.902823 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a806adf1-9639-42b6-b121-895dc71fb897 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.214412 Jun 16 17:26:08.912927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 215/423] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:08 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:08.962645 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.objects.instance [None req-47cafd22-3565-476f-825b-aa81087f1e91 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lazy-loading 'services' on Instance uuid 0e36f5bc-922d-4dfe-9ecb-49ba6c855878 {{(pid=117552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:26:09.113054 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-47cafd22-3565-476f-825b-aa81087f1e91 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878/os-volume_attachments/2833bb92-c3be-4192-9031-ea888dfc80cd" status: 202 len: 0 microversion: 2.1 time: 0.328116 Jun 16 17:26:09.119268 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 209/424] 10.222.0.66 () {58 vars in 1415 bytes} [Thu Jun 16 17:26:08 2022] DELETE /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878/os-volume_attachments/2833bb92-c3be-4192-9031-ea888dfc80cd => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:26:09.281270 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-6c6558a7-df25-406d-b2d2-d92f29dfc287 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:09.282002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-6c6558a7-df25-406d-b2d2-d92f29dfc287 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:09.288806 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6c6558a7-df25-406d-b2d2-d92f29dfc287 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:09.289279 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6c6558a7-df25-406d-b2d2-d92f29dfc287 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:09.290047 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6c6558a7-df25-406d-b2d2-d92f29dfc287 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:09.290471 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6c6558a7-df25-406d-b2d2-d92f29dfc287 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:09.356376 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6c6558a7-df25-406d-b2d2-d92f29dfc287 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:09.365207 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-6c6558a7-df25-406d-b2d2-d92f29dfc287 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1145 microversion: 2.1 time: 0.087800 Jun 16 17:26:09.365806 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 216/425] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:09 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:09.517365 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-57cd0e13-a305-4693-980b-55db132cca06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:09.518050 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-57cd0e13-a305-4693-980b-55db132cca06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:09.520110 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:09.531897 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-57cd0e13-a305-4693-980b-55db132cca06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:09.532256 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-57cd0e13-a305-4693-980b-55db132cca06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:09.533053 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-57cd0e13-a305-4693-980b-55db132cca06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:09.537219 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-57cd0e13-a305-4693-980b-55db132cca06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:09.675430 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-57cd0e13-a305-4693-980b-55db132cca06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:09.687377 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-57cd0e13-a305-4693-980b-55db132cca06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:09.689912 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-57cd0e13-a305-4693-980b-55db132cca06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:09.691599 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-57cd0e13-a305-4693-980b-55db132cca06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.179869 Jun 16 17:26:09.693228 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 210/426] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:09 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:09.920925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-693a2e1e-1f8f-4b85-a484-d945f9af1e8d tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:09.922302 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-693a2e1e-1f8f-4b85-a484-d945f9af1e8d tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:09.948072 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-693a2e1e-1f8f-4b85-a484-d945f9af1e8d tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:09.948555 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-693a2e1e-1f8f-4b85-a484-d945f9af1e8d tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:09.949409 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-693a2e1e-1f8f-4b85-a484-d945f9af1e8d tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:09.949844 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-693a2e1e-1f8f-4b85-a484-d945f9af1e8d tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:10.092754 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-693a2e1e-1f8f-4b85-a484-d945f9af1e8d tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:10.100757 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-693a2e1e-1f8f-4b85-a484-d945f9af1e8d tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.184847 Jun 16 17:26:10.111349 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 217/427] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:09 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:10.383456 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-623fdcce-20a7-45a5-927d-cb19c29f2bc2 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:10.384065 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-623fdcce-20a7-45a5-927d-cb19c29f2bc2 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:10.392168 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-623fdcce-20a7-45a5-927d-cb19c29f2bc2 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:10.392594 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-623fdcce-20a7-45a5-927d-cb19c29f2bc2 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:10.393452 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-623fdcce-20a7-45a5-927d-cb19c29f2bc2 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:10.393871 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-623fdcce-20a7-45a5-927d-cb19c29f2bc2 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:10.461114 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-623fdcce-20a7-45a5-927d-cb19c29f2bc2 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:10.469803 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-623fdcce-20a7-45a5-927d-cb19c29f2bc2 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1145 microversion: 2.1 time: 0.090868 Jun 16 17:26:10.471213 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 211/428] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:10 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:10.577524 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-8d67c54c-5bab-441f-a743-df24d350827e req-cc9dc6d6-a993-467e-b41a-4235cd1cff1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ee9b10-f2da-442c-9475-3cfb21c9ad54", "name": "network-vif-plugged", "status": "completed", "tag": "676f9af5-715a-4f80-b6f8-747296e84e2c"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:10.589256 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-8d67c54c-5bab-441f-a743-df24d350827e req-cc9dc6d6-a993-467e-b41a-4235cd1cff1c service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:10.590032 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-8d67c54c-5bab-441f-a743-df24d350827e req-cc9dc6d6-a993-467e-b41a-4235cd1cff1c service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:10.604471 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-8d67c54c-5bab-441f-a743-df24d350827e req-cc9dc6d6-a993-467e-b41a-4235cd1cff1c service nova] Creating event network-vif-plugged:676f9af5-715a-4f80-b6f8-747296e84e2c for instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 on hv-cinder-83735 Jun 16 17:26:10.610184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-8d67c54c-5bab-441f-a743-df24d350827e req-cc9dc6d6-a993-467e-b41a-4235cd1cff1c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036549 Jun 16 17:26:10.611126 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 218/429] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:26:10.717723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-04d3cf0f-3ed2-4d34-a102-a2d5e0dd42e7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:10.720307 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-04d3cf0f-3ed2-4d34-a102-a2d5e0dd42e7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:10.731653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-04d3cf0f-3ed2-4d34-a102-a2d5e0dd42e7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:10.732566 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-04d3cf0f-3ed2-4d34-a102-a2d5e0dd42e7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:10.734154 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-04d3cf0f-3ed2-4d34-a102-a2d5e0dd42e7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:10.735138 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-04d3cf0f-3ed2-4d34-a102-a2d5e0dd42e7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:11.020620 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-04d3cf0f-3ed2-4d34-a102-a2d5e0dd42e7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:11.052302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-04d3cf0f-3ed2-4d34-a102-a2d5e0dd42e7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:11.055216 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-04d3cf0f-3ed2-4d34-a102-a2d5e0dd42e7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:11.057685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-04d3cf0f-3ed2-4d34-a102-a2d5e0dd42e7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.349977 Jun 16 17:26:11.059884 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 212/430] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:10 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:26:11.122517 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-acaca776-d184-4aec-8a42-9ba48acfb05b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:11.123404 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-acaca776-d184-4aec-8a42-9ba48acfb05b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:11.131510 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-acaca776-d184-4aec-8a42-9ba48acfb05b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:11.132214 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-acaca776-d184-4aec-8a42-9ba48acfb05b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:11.133606 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-acaca776-d184-4aec-8a42-9ba48acfb05b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:11.134155 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-acaca776-d184-4aec-8a42-9ba48acfb05b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:11.449250 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-acaca776-d184-4aec-8a42-9ba48acfb05b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:11.481926 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-acaca776-d184-4aec-8a42-9ba48acfb05b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.365011 Jun 16 17:26:11.482653 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 219/431] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:11 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:11.494716 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-27c6cc3f-8270-47ea-b35c-e37eae491afa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:11.495853 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-27c6cc3f-8270-47ea-b35c-e37eae491afa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:11.515298 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-27c6cc3f-8270-47ea-b35c-e37eae491afa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:11.516054 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-27c6cc3f-8270-47ea-b35c-e37eae491afa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:11.519537 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-27c6cc3f-8270-47ea-b35c-e37eae491afa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:11.520571 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-27c6cc3f-8270-47ea-b35c-e37eae491afa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:11.602156 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-27c6cc3f-8270-47ea-b35c-e37eae491afa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:11.620042 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-27c6cc3f-8270-47ea-b35c-e37eae491afa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1145 microversion: 2.1 time: 0.131965 Jun 16 17:26:11.620825 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 213/432] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:11 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1145 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:12.087177 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c01fe2e1-f640-4f05-94cf-985ba0f2fd41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:12.088443 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c01fe2e1-f640-4f05-94cf-985ba0f2fd41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:12.095648 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c01fe2e1-f640-4f05-94cf-985ba0f2fd41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:12.096428 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c01fe2e1-f640-4f05-94cf-985ba0f2fd41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:12.097249 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c01fe2e1-f640-4f05-94cf-985ba0f2fd41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:12.097682 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c01fe2e1-f640-4f05-94cf-985ba0f2fd41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:12.258108 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c01fe2e1-f640-4f05-94cf-985ba0f2fd41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:12.260755 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=100 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:12.270455 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c01fe2e1-f640-4f05-94cf-985ba0f2fd41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:12.272164 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c01fe2e1-f640-4f05-94cf-985ba0f2fd41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:12.274506 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c01fe2e1-f640-4f05-94cf-985ba0f2fd41 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.191177 Jun 16 17:26:12.275248 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 220/433] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:12 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:12.507569 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-26af8617-9532-40c9-9933-1942cc83a52a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:12.508277 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-26af8617-9532-40c9-9933-1942cc83a52a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:12.515965 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-26af8617-9532-40c9-9933-1942cc83a52a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:12.516738 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-26af8617-9532-40c9-9933-1942cc83a52a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:12.518118 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-26af8617-9532-40c9-9933-1942cc83a52a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:12.518851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-26af8617-9532-40c9-9933-1942cc83a52a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:12.639864 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-3fd9fd8c-6a78-4063-a10f-473973589580 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:12.640716 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-3fd9fd8c-6a78-4063-a10f-473973589580 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:12.649075 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3fd9fd8c-6a78-4063-a10f-473973589580 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:12.649403 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3fd9fd8c-6a78-4063-a10f-473973589580 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:12.650194 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3fd9fd8c-6a78-4063-a10f-473973589580 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:12.650910 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3fd9fd8c-6a78-4063-a10f-473973589580 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:12.682235 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-26af8617-9532-40c9-9933-1942cc83a52a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:12.702149 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-26af8617-9532-40c9-9933-1942cc83a52a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.199422 Jun 16 17:26:12.702935 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 214/434] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:12 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:12.721128 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-3fd9fd8c-6a78-4063-a10f-473973589580 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:12.731364 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-3fd9fd8c-6a78-4063-a10f-473973589580 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1145 microversion: 2.1 time: 0.093954 Jun 16 17:26:12.731975 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 221/435] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:12 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:13.292919 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b5d2ac43-253c-4bb7-8ec9-f61238b440fb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:13.293469 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b5d2ac43-253c-4bb7-8ec9-f61238b440fb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:13.300030 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b5d2ac43-253c-4bb7-8ec9-f61238b440fb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:13.300465 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b5d2ac43-253c-4bb7-8ec9-f61238b440fb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:13.301296 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b5d2ac43-253c-4bb7-8ec9-f61238b440fb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:13.301728 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b5d2ac43-253c-4bb7-8ec9-f61238b440fb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:13.488264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-b5d2ac43-253c-4bb7-8ec9-f61238b440fb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:13.505101 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-b5d2ac43-253c-4bb7-8ec9-f61238b440fb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:13.511160 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-b5d2ac43-253c-4bb7-8ec9-f61238b440fb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:13.515020 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b5d2ac43-253c-4bb7-8ec9-f61238b440fb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.226353 Jun 16 17:26:13.515020 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 215/436] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:13 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:13.719354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-04505b91-92e6-4516-83eb-2e4c675f9325 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:13.720766 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-04505b91-92e6-4516-83eb-2e4c675f9325 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:13.728455 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-04505b91-92e6-4516-83eb-2e4c675f9325 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:13.728913 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-04505b91-92e6-4516-83eb-2e4c675f9325 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:13.729712 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-04505b91-92e6-4516-83eb-2e4c675f9325 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:13.730135 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-04505b91-92e6-4516-83eb-2e4c675f9325 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:13.751410 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7512a7dd-4877-4980-a488-cc294ff9d5d3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:13.752170 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7512a7dd-4877-4980-a488-cc294ff9d5d3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:13.759070 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7512a7dd-4877-4980-a488-cc294ff9d5d3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:13.759703 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7512a7dd-4877-4980-a488-cc294ff9d5d3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:13.760689 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7512a7dd-4877-4980-a488-cc294ff9d5d3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:13.761258 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7512a7dd-4877-4980-a488-cc294ff9d5d3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:13.833969 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7512a7dd-4877-4980-a488-cc294ff9d5d3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:13.843350 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7512a7dd-4877-4980-a488-cc294ff9d5d3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1145 microversion: 2.1 time: 0.099604 Jun 16 17:26:13.854201 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 216/437] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:13 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1145 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:13.904196 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-04505b91-92e6-4516-83eb-2e4c675f9325 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:13.913296 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-04505b91-92e6-4516-83eb-2e4c675f9325 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.197550 Jun 16 17:26:13.914412 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 222/438] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:13 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:14.532906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-955b18de-85aa-4a78-97e3-d4e35ed82373 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:14.534251 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-955b18de-85aa-4a78-97e3-d4e35ed82373 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:14.540711 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-955b18de-85aa-4a78-97e3-d4e35ed82373 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:14.541143 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-955b18de-85aa-4a78-97e3-d4e35ed82373 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:14.541946 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-955b18de-85aa-4a78-97e3-d4e35ed82373 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:14.542371 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-955b18de-85aa-4a78-97e3-d4e35ed82373 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:14.687706 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-955b18de-85aa-4a78-97e3-d4e35ed82373 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:14.698412 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-955b18de-85aa-4a78-97e3-d4e35ed82373 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:14.700399 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-955b18de-85aa-4a78-97e3-d4e35ed82373 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:14.703139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-955b18de-85aa-4a78-97e3-d4e35ed82373 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.172724 Jun 16 17:26:14.703442 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 217/439] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:14 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:14.862813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ebd332ea-9936-4ab0-b485-011875fcccc3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:14.863971 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ebd332ea-9936-4ab0-b485-011875fcccc3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:14.871141 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ebd332ea-9936-4ab0-b485-011875fcccc3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:14.871665 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ebd332ea-9936-4ab0-b485-011875fcccc3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:14.872504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ebd332ea-9936-4ab0-b485-011875fcccc3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:14.872996 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ebd332ea-9936-4ab0-b485-011875fcccc3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:14.935756 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-05f98367-4189-40f1-8dac-57d1cc468c82 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:14.936747 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-05f98367-4189-40f1-8dac-57d1cc468c82 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:14.945893 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ebd332ea-9936-4ab0-b485-011875fcccc3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:14.949493 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-05f98367-4189-40f1-8dac-57d1cc468c82 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:14.949629 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-05f98367-4189-40f1-8dac-57d1cc468c82 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:14.950393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-05f98367-4189-40f1-8dac-57d1cc468c82 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:14.950816 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-05f98367-4189-40f1-8dac-57d1cc468c82 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:14.954341 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ebd332ea-9936-4ab0-b485-011875fcccc3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1145 microversion: 2.1 time: 0.096969 Jun 16 17:26:14.955105 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 223/440] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:14 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:15.106442 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-05f98367-4189-40f1-8dac-57d1cc468c82 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:15.114741 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-05f98367-4189-40f1-8dac-57d1cc468c82 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.187322 Jun 16 17:26:15.115328 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 218/441] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:14 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:15.723296 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-020a60a5-bdac-4288-8e0a-bc9413016a4c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:15.724231 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-020a60a5-bdac-4288-8e0a-bc9413016a4c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:15.739053 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-020a60a5-bdac-4288-8e0a-bc9413016a4c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:15.739484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-020a60a5-bdac-4288-8e0a-bc9413016a4c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:15.740242 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-020a60a5-bdac-4288-8e0a-bc9413016a4c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:15.740701 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-020a60a5-bdac-4288-8e0a-bc9413016a4c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:15.910862 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-020a60a5-bdac-4288-8e0a-bc9413016a4c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:15.921112 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-020a60a5-bdac-4288-8e0a-bc9413016a4c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:15.922637 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-020a60a5-bdac-4288-8e0a-bc9413016a4c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:15.923789 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-020a60a5-bdac-4288-8e0a-bc9413016a4c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.206355 Jun 16 17:26:15.924307 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 224/442] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:15 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:15.974522 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-249dac9f-e977-4ea8-873f-5c3b47cb7486 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:15.975085 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-249dac9f-e977-4ea8-873f-5c3b47cb7486 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:15.982372 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-249dac9f-e977-4ea8-873f-5c3b47cb7486 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:15.982820 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-249dac9f-e977-4ea8-873f-5c3b47cb7486 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:15.983588 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-249dac9f-e977-4ea8-873f-5c3b47cb7486 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:15.984347 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-249dac9f-e977-4ea8-873f-5c3b47cb7486 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:16.050433 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-249dac9f-e977-4ea8-873f-5c3b47cb7486 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:16.058566 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-249dac9f-e977-4ea8-873f-5c3b47cb7486 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1137 microversion: 2.1 time: 0.089648 Jun 16 17:26:16.059135 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 219/443] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:15 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:16.135161 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-325635a7-b7e3-49d1-bd73-8f9d99b59ab1 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:16.135751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-325635a7-b7e3-49d1-bd73-8f9d99b59ab1 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:16.144138 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-325635a7-b7e3-49d1-bd73-8f9d99b59ab1 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:16.144707 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-325635a7-b7e3-49d1-bd73-8f9d99b59ab1 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:16.146010 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-325635a7-b7e3-49d1-bd73-8f9d99b59ab1 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:16.146669 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-325635a7-b7e3-49d1-bd73-8f9d99b59ab1 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:16.307205 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-325635a7-b7e3-49d1-bd73-8f9d99b59ab1 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:16.315636 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-325635a7-b7e3-49d1-bd73-8f9d99b59ab1 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.184410 Jun 16 17:26:16.316219 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 225/444] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:16 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:16.570344 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9407508f-f41a-4eb5-9a09-7c0125ba0453 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:16.570842 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-9407508f-f41a-4eb5-9a09-7c0125ba0453 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:16.577964 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9407508f-f41a-4eb5-9a09-7c0125ba0453 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:16.578408 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9407508f-f41a-4eb5-9a09-7c0125ba0453 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:16.579159 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9407508f-f41a-4eb5-9a09-7c0125ba0453 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:16.579586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9407508f-f41a-4eb5-9a09-7c0125ba0453 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:16.622011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:16.670964 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.objects.instance [None req-9407508f-f41a-4eb5-9a09-7c0125ba0453 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lazy-loading 'services' on Instance uuid 7d22b60d-19fe-4dca-8eef-821db5a4dc55 {{(pid=117552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:26:16.752116 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9407508f-f41a-4eb5-9a09-7c0125ba0453 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/os-volume_attachments/012b766a-7d34-46be-a811-430fe788ce04" status: 202 len: 0 microversion: 2.1 time: 0.187208 Jun 16 17:26:16.752712 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 220/445] 10.222.0.66 () {58 vars in 1415 bytes} [Thu Jun 16 17:26:16 2022] DELETE /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/os-volume_attachments/012b766a-7d34-46be-a811-430fe788ce04 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:26:16.944715 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-42741b00-5b4c-4d31-ac89-05049dab3dac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:16.945924 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-42741b00-5b4c-4d31-ac89-05049dab3dac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:16.954164 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-42741b00-5b4c-4d31-ac89-05049dab3dac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:16.954694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-42741b00-5b4c-4d31-ac89-05049dab3dac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:16.955698 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-42741b00-5b4c-4d31-ac89-05049dab3dac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:16.956350 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-42741b00-5b4c-4d31-ac89-05049dab3dac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:17.078769 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-004a59a3-646b-44cd-9c58-5756923156aa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:17.079609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-004a59a3-646b-44cd-9c58-5756923156aa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:17.087636 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-004a59a3-646b-44cd-9c58-5756923156aa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:17.088106 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-004a59a3-646b-44cd-9c58-5756923156aa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:17.088876 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-004a59a3-646b-44cd-9c58-5756923156aa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:17.089344 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-004a59a3-646b-44cd-9c58-5756923156aa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:17.102235 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-42741b00-5b4c-4d31-ac89-05049dab3dac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:17.113503 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-42741b00-5b4c-4d31-ac89-05049dab3dac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:17.114994 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-42741b00-5b4c-4d31-ac89-05049dab3dac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:17.116150 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-42741b00-5b4c-4d31-ac89-05049dab3dac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.177556 Jun 16 17:26:17.117667 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 226/446] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:16 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:17.128237 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=8 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:17.158439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-004a59a3-646b-44cd-9c58-5756923156aa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:17.166825 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-004a59a3-646b-44cd-9c58-5756923156aa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1193 microversion: 2.1 time: 0.092219 Jun 16 17:26:17.167391 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 221/447] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:17 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1193 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:17.335190 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8a13d05c-dcd1-4378-b9fd-c6a4cbaeb3c0 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:17.335890 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-8a13d05c-dcd1-4378-b9fd-c6a4cbaeb3c0 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:17.344710 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8a13d05c-dcd1-4378-b9fd-c6a4cbaeb3c0 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:17.345451 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8a13d05c-dcd1-4378-b9fd-c6a4cbaeb3c0 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:17.346608 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8a13d05c-dcd1-4378-b9fd-c6a4cbaeb3c0 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:17.347281 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8a13d05c-dcd1-4378-b9fd-c6a4cbaeb3c0 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:17.495754 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8a13d05c-dcd1-4378-b9fd-c6a4cbaeb3c0 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:17.503301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8a13d05c-dcd1-4378-b9fd-c6a4cbaeb3c0 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1358 microversion: 2.1 time: 0.174080 Jun 16 17:26:17.503876 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 227/448] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:17 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:17.521790 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-1b4cff4a-9a19-495c-8cac-bee8f54a6777 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:17.523185 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-1b4cff4a-9a19-495c-8cac-bee8f54a6777 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:17.529784 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1b4cff4a-9a19-495c-8cac-bee8f54a6777 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:17.530226 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1b4cff4a-9a19-495c-8cac-bee8f54a6777 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:17.531024 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1b4cff4a-9a19-495c-8cac-bee8f54a6777 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:17.531446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1b4cff4a-9a19-495c-8cac-bee8f54a6777 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:17.555410 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.objects.instance [None req-1b4cff4a-9a19-495c-8cac-bee8f54a6777 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lazy-loading 'flavor' on Instance uuid 4065d5c1-0b16-413a-a5b5-e0e725e1e71b {{(pid=117552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:26:17.686149 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:17.697956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-1b4cff4a-9a19-495c-8cac-bee8f54a6777 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "POST /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/action" status: 200 len: 32 microversion: 2.1 time: 0.180869 Jun 16 17:26:17.698562 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 222/449] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jun 16 17:26:17 2022] POST /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:26:17.709490 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-695a5742-97c4-4da9-8826-c28c055bbdb9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:17.710093 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-695a5742-97c4-4da9-8826-c28c055bbdb9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:17.717642 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-695a5742-97c4-4da9-8826-c28c055bbdb9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:17.718121 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-695a5742-97c4-4da9-8826-c28c055bbdb9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:17.718914 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-695a5742-97c4-4da9-8826-c28c055bbdb9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:17.719348 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-695a5742-97c4-4da9-8826-c28c055bbdb9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:17.887755 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-695a5742-97c4-4da9-8826-c28c055bbdb9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:17.896120 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-695a5742-97c4-4da9-8826-c28c055bbdb9 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.190608 Jun 16 17:26:17.896686 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 228/450] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:17 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:18.136982 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5d806726-8ff8-49ef-b73c-8f11960cc4a1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:18.137829 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-5d806726-8ff8-49ef-b73c-8f11960cc4a1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:18.144265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5d806726-8ff8-49ef-b73c-8f11960cc4a1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:18.144708 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5d806726-8ff8-49ef-b73c-8f11960cc4a1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:18.145499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5d806726-8ff8-49ef-b73c-8f11960cc4a1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:18.145962 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5d806726-8ff8-49ef-b73c-8f11960cc4a1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:18.184951 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-9e700020-5906-48fa-89fa-7ab02f585e83 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:18.185678 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-9e700020-5906-48fa-89fa-7ab02f585e83 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:18.193000 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9e700020-5906-48fa-89fa-7ab02f585e83 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:18.193493 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9e700020-5906-48fa-89fa-7ab02f585e83 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:18.194261 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9e700020-5906-48fa-89fa-7ab02f585e83 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:18.194734 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9e700020-5906-48fa-89fa-7ab02f585e83 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:18.258022 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-9e700020-5906-48fa-89fa-7ab02f585e83 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:18.265686 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-9e700020-5906-48fa-89fa-7ab02f585e83 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1201 microversion: 2.1 time: 0.085062 Jun 16 17:26:18.266723 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 229/451] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:18 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1201 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:18.287460 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5d806726-8ff8-49ef-b73c-8f11960cc4a1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:18.297346 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5d806726-8ff8-49ef-b73c-8f11960cc4a1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:18.298840 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5d806726-8ff8-49ef-b73c-8f11960cc4a1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:18.300007 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-5d806726-8ff8-49ef-b73c-8f11960cc4a1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.169269 Jun 16 17:26:18.300569 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 223/452] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:18 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:18.520139 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a2dcbcae-e613-4214-bd95-2d9344f1947a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:18.521380 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a2dcbcae-e613-4214-bd95-2d9344f1947a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:18.528014 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a2dcbcae-e613-4214-bd95-2d9344f1947a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:18.528542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a2dcbcae-e613-4214-bd95-2d9344f1947a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:18.529612 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a2dcbcae-e613-4214-bd95-2d9344f1947a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:18.530040 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a2dcbcae-e613-4214-bd95-2d9344f1947a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:18.695690 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a2dcbcae-e613-4214-bd95-2d9344f1947a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:18.703776 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a2dcbcae-e613-4214-bd95-2d9344f1947a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1549 microversion: 2.1 time: 0.187398 Jun 16 17:26:18.704255 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 230/453] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:18 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1549 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:18.721000 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-40254a8a-8d58-4004-904d-575a54f3011e tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:18.721649 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-40254a8a-8d58-4004-904d-575a54f3011e tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:18.730333 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-40254a8a-8d58-4004-904d-575a54f3011e tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:18.730756 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-40254a8a-8d58-4004-904d-575a54f3011e tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:18.731524 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-40254a8a-8d58-4004-904d-575a54f3011e tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:18.732125 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-40254a8a-8d58-4004-904d-575a54f3011e tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:18.905975 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-9a04db58-cdda-41b7-939e-7b588fbb6e1e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:18.906642 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-9a04db58-cdda-41b7-939e-7b588fbb6e1e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:18.913397 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9a04db58-cdda-41b7-939e-7b588fbb6e1e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:18.913987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9a04db58-cdda-41b7-939e-7b588fbb6e1e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:18.914756 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9a04db58-cdda-41b7-939e-7b588fbb6e1e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:18.915191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9a04db58-cdda-41b7-939e-7b588fbb6e1e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:18.944367 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-9a04db58-cdda-41b7-939e-7b588fbb6e1e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Going to try to terminate instance {{(pid=117553) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:26:19.036621 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-9a04db58-cdda-41b7-939e-7b588fbb6e1e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 204 len: 0 microversion: 2.1 time: 0.134330 Jun 16 17:26:19.037227 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 231/454] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:26:18 2022] DELETE /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 17:26:19.043407 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4f47f687-cb47-4f47-b3b5-027221bede9c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:19.044117 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4f47f687-cb47-4f47-b3b5-027221bede9c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:19.050421 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4f47f687-cb47-4f47-b3b5-027221bede9c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:19.050904 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4f47f687-cb47-4f47-b3b5-027221bede9c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:19.051771 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4f47f687-cb47-4f47-b3b5-027221bede9c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:19.052406 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4f47f687-cb47-4f47-b3b5-027221bede9c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:19.075078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-40254a8a-8d58-4004-904d-575a54f3011e tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:19.082880 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-40254a8a-8d58-4004-904d-575a54f3011e tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1549 microversion: 2.1 time: 0.365814 Jun 16 17:26:19.083438 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 224/455] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:18 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1549 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:19.088027 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-907dbdbd-f3b0-4dd1-8795-e806045199a2 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:19.088625 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-907dbdbd-f3b0-4dd1-8795-e806045199a2 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:19.096167 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-907dbdbd-f3b0-4dd1-8795-e806045199a2 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:19.096612 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-907dbdbd-f3b0-4dd1-8795-e806045199a2 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:19.097420 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-907dbdbd-f3b0-4dd1-8795-e806045199a2 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:19.097847 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-907dbdbd-f3b0-4dd1-8795-e806045199a2 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:19.212749 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4f47f687-cb47-4f47-b3b5-027221bede9c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:19.220576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4f47f687-cb47-4f47-b3b5-027221bede9c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.182102 Jun 16 17:26:19.221359 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 232/456] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:19 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:19.226778 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2e45819f-4514-4091-ab6b-29610f457b9c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:19.231324 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2e45819f-4514-4091-ab6b-29610f457b9c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:19.232181 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2e45819f-4514-4091-ab6b-29610f457b9c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Searching by: {'deleted': False, 'project_id': '546929b1810a4d20b273f3e5492ec6ed'} {{(pid=117553) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 17:26:19.239514 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2e45819f-4514-4091-ab6b-29610f457b9c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:19.239949 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2e45819f-4514-4091-ab6b-29610f457b9c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:19.240731 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2e45819f-4514-4091-ab6b-29610f457b9c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:19.241149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2e45819f-4514-4091-ab6b-29610f457b9c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:19.339181 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.multi_cell_list [None req-2e45819f-4514-4091-ab6b-29610f457b9c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117553) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 17:26:19.397810 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-907dbdbd-f3b0-4dd1-8795-e806045199a2 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:19.406182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-907dbdbd-f3b0-4dd1-8795-e806045199a2 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 200 len: 1513 microversion: 2.1 time: 0.321617 Jun 16 17:26:19.406942 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 225/457] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:19 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 1513 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:19.411989 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ef2e3752-4d7b-4fac-a01f-fc22a1281aa8 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:19.412806 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ef2e3752-4d7b-4fac-a01f-fc22a1281aa8 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:19.420381 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ef2e3752-4d7b-4fac-a01f-fc22a1281aa8 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:19.421425 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ef2e3752-4d7b-4fac-a01f-fc22a1281aa8 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:19.422468 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ef2e3752-4d7b-4fac-a01f-fc22a1281aa8 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:19.423075 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ef2e3752-4d7b-4fac-a01f-fc22a1281aa8 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:19.449596 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2e45819f-4514-4091-ab6b-29610f457b9c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.226819 Jun 16 17:26:19.459062 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 233/458] 10.222.0.66 () {58 vars in 1124 bytes} [Thu Jun 16 17:26:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:26:19.459377 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7ec34d70-82ba-44f5-bbb0-079c32dbbd64 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:19.459975 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-7ec34d70-82ba-44f5-bbb0-079c32dbbd64 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:19.467346 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7ec34d70-82ba-44f5-bbb0-079c32dbbd64 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:19.468057 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7ec34d70-82ba-44f5-bbb0-079c32dbbd64 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:19.468830 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7ec34d70-82ba-44f5-bbb0-079c32dbbd64 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:19.469292 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7ec34d70-82ba-44f5-bbb0-079c32dbbd64 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:19.519148 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ef2e3752-4d7b-4fac-a01f-fc22a1281aa8 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:19.531013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ef2e3752-4d7b-4fac-a01f-fc22a1281aa8 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1211 microversion: 2.1 time: 0.122658 Jun 16 17:26:19.531868 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 226/459] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:19 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1211 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:19.536883 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9c07bea1-8d40-4b27-81a2-1414650e2372 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:19.537952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-9c07bea1-8d40-4b27-81a2-1414650e2372 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:19.545717 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9c07bea1-8d40-4b27-81a2-1414650e2372 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:19.546385 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9c07bea1-8d40-4b27-81a2-1414650e2372 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:19.547487 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9c07bea1-8d40-4b27-81a2-1414650e2372 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:19.548231 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9c07bea1-8d40-4b27-81a2-1414650e2372 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:19.641986 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7ec34d70-82ba-44f5-bbb0-079c32dbbd64 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:19.651645 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7ec34d70-82ba-44f5-bbb0-079c32dbbd64 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:19.653225 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7ec34d70-82ba-44f5-bbb0-079c32dbbd64 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:19.654857 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7ec34d70-82ba-44f5-bbb0-079c32dbbd64 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.202641 Jun 16 17:26:19.655533 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 234/460] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:19 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:19.792135 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9c07bea1-8d40-4b27-81a2-1414650e2372 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:19.800958 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9c07bea1-8d40-4b27-81a2-1414650e2372 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1549 microversion: 2.1 time: 0.267615 Jun 16 17:26:19.801589 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 227/461] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:19 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1549 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:20.240339 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-fed313d7-73ab-4a5f-888f-68cde72144d1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:20.240872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-fed313d7-73ab-4a5f-888f-68cde72144d1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:20.250241 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fed313d7-73ab-4a5f-888f-68cde72144d1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:20.250674 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fed313d7-73ab-4a5f-888f-68cde72144d1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:20.251464 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fed313d7-73ab-4a5f-888f-68cde72144d1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:20.251967 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fed313d7-73ab-4a5f-888f-68cde72144d1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:20.268261 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:20.402053 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-fed313d7-73ab-4a5f-888f-68cde72144d1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:20.410257 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-fed313d7-73ab-4a5f-888f-68cde72144d1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.174797 Jun 16 17:26:20.410803 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 235/462] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:20 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:20.426132 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-fd63003e-ba29-494a-a281-c88c4071701e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:20.426763 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-fd63003e-ba29-494a-a281-c88c4071701e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:20.436426 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fd63003e-ba29-494a-a281-c88c4071701e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:20.436849 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fd63003e-ba29-494a-a281-c88c4071701e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:20.437722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fd63003e-ba29-494a-a281-c88c4071701e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:20.438130 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fd63003e-ba29-494a-a281-c88c4071701e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:20.548316 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-0821a843-22f2-491b-ba69-de028535b234 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:20.548999 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-0821a843-22f2-491b-ba69-de028535b234 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:20.555500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0821a843-22f2-491b-ba69-de028535b234 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:20.555943 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0821a843-22f2-491b-ba69-de028535b234 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:20.556708 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0821a843-22f2-491b-ba69-de028535b234 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:20.557132 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0821a843-22f2-491b-ba69-de028535b234 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:20.583338 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-fd63003e-ba29-494a-a281-c88c4071701e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:20.591802 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-fd63003e-ba29-494a-a281-c88c4071701e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 200 len: 1513 microversion: 2.1 time: 0.171386 Jun 16 17:26:20.592400 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 228/463] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:20 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:20.677739 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f98b0628-8057-42d8-acb2-e297563d3c59 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:20.678367 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f98b0628-8057-42d8-acb2-e297563d3c59 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:20.684883 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f98b0628-8057-42d8-acb2-e297563d3c59 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:20.685361 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f98b0628-8057-42d8-acb2-e297563d3c59 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:20.686143 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f98b0628-8057-42d8-acb2-e297563d3c59 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:20.686864 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f98b0628-8057-42d8-acb2-e297563d3c59 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:20.698575 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0821a843-22f2-491b-ba69-de028535b234 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:20.707026 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-0821a843-22f2-491b-ba69-de028535b234 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1278 microversion: 2.1 time: 0.162493 Jun 16 17:26:20.707953 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 236/464] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:20 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:20.976399 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f98b0628-8057-42d8-acb2-e297563d3c59 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:20.986231 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f98b0628-8057-42d8-acb2-e297563d3c59 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:20.987617 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f98b0628-8057-42d8-acb2-e297563d3c59 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:20.988773 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f98b0628-8057-42d8-acb2-e297563d3c59 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.315000 Jun 16 17:26:20.989332 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 229/465] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:20 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:21.431180 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ccfb91d4-1df6-4878-ad32-9f3abcd6dab2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:21.433222 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ccfb91d4-1df6-4878-ad32-9f3abcd6dab2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:21.440640 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ccfb91d4-1df6-4878-ad32-9f3abcd6dab2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:21.441407 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ccfb91d4-1df6-4878-ad32-9f3abcd6dab2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:21.442543 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ccfb91d4-1df6-4878-ad32-9f3abcd6dab2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:21.443136 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ccfb91d4-1df6-4878-ad32-9f3abcd6dab2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:21.459452 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f13456cb-94bf-44ad-9ed4-7cc462bf7018 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73bbafb4-a61a-45be-9374-ee4e8dd4702a"}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:21.460961 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f13456cb-94bf-44ad-9ed4-7cc462bf7018 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:21.486160 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f13456cb-94bf-44ad-9ed4-7cc462bf7018 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:21.493708 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f13456cb-94bf-44ad-9ed4-7cc462bf7018 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:21.495750 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f13456cb-94bf-44ad-9ed4-7cc462bf7018 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:21.496330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f13456cb-94bf-44ad-9ed4-7cc462bf7018 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:21.700072 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ccfb91d4-1df6-4878-ad32-9f3abcd6dab2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:21.712732 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ccfb91d4-1df6-4878-ad32-9f3abcd6dab2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.285469 Jun 16 17:26:21.714895 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 237/466] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:21 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:21.721608 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-bb46583a-a598-4b64-ba57-b8fc7996a5ca tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:21.724026 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-bb46583a-a598-4b64-ba57-b8fc7996a5ca tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:21.736534 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bb46583a-a598-4b64-ba57-b8fc7996a5ca tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:21.737651 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bb46583a-a598-4b64-ba57-b8fc7996a5ca tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:21.738920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bb46583a-a598-4b64-ba57-b8fc7996a5ca tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:21.739545 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bb46583a-a598-4b64-ba57-b8fc7996a5ca tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:22.016039 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-bb46583a-a598-4b64-ba57-b8fc7996a5ca tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:22.026932 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-bb46583a-a598-4b64-ba57-b8fc7996a5ca tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 200 len: 1513 microversion: 2.1 time: 0.310400 Jun 16 17:26:22.027767 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 238/467] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:21 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 1513 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:22.037153 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-50af1e4e-9151-4de8-9743-491f5c0f3859 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:22.037768 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-50af1e4e-9151-4de8-9743-491f5c0f3859 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:22.044323 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-50af1e4e-9151-4de8-9743-491f5c0f3859 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:22.044838 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-50af1e4e-9151-4de8-9743-491f5c0f3859 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:22.045718 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-50af1e4e-9151-4de8-9743-491f5c0f3859 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:22.046491 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-50af1e4e-9151-4de8-9743-491f5c0f3859 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:22.196333 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-50af1e4e-9151-4de8-9743-491f5c0f3859 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:22.207931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-50af1e4e-9151-4de8-9743-491f5c0f3859 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1278 microversion: 2.1 time: 0.174083 Jun 16 17:26:22.208707 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 239/468] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:22 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:22.213343 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-a854840e-48f1-4236-9a1f-488802c2e311 req-a0c1f0b8-2565-4fa9-99dd-a9a8d0789821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157a0c77-c88e-4ef0-aef5-6ba851b57d00", "tag": "0fdde9ef-e61f-4c66-9976-8477640c42a6"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:22.221546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-a854840e-48f1-4236-9a1f-488802c2e311 req-a0c1f0b8-2565-4fa9-99dd-a9a8d0789821 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:22.221985 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-a854840e-48f1-4236-9a1f-488802c2e311 req-a0c1f0b8-2565-4fa9-99dd-a9a8d0789821 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:22.233640 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-a854840e-48f1-4236-9a1f-488802c2e311 req-a0c1f0b8-2565-4fa9-99dd-a9a8d0789821 service nova] Creating event network-changed:0fdde9ef-e61f-4c66-9976-8477640c42a6 for instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 on hv-cinder-83735 Jun 16 17:26:22.239142 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-a854840e-48f1-4236-9a1f-488802c2e311 req-a0c1f0b8-2565-4fa9-99dd-a9a8d0789821 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029289 Jun 16 17:26:22.239727 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 240/469] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:26:22.244661 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-395b31be-1347-4fd8-a53c-54cea1d59d50 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:22.245387 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-395b31be-1347-4fd8-a53c-54cea1d59d50 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:22.253371 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-395b31be-1347-4fd8-a53c-54cea1d59d50 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:22.253856 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-395b31be-1347-4fd8-a53c-54cea1d59d50 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:22.254625 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-395b31be-1347-4fd8-a53c-54cea1d59d50 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:22.255121 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-395b31be-1347-4fd8-a53c-54cea1d59d50 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:22.519472 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-395b31be-1347-4fd8-a53c-54cea1d59d50 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:22.536950 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-395b31be-1347-4fd8-a53c-54cea1d59d50 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:22.539454 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-395b31be-1347-4fd8-a53c-54cea1d59d50 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:22.540990 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-395b31be-1347-4fd8-a53c-54cea1d59d50 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.300237 Jun 16 17:26:22.542248 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 241/470] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:22 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:22.548119 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-6b928354-55f8-439d-a515-872f52797ab0 req-509f4fb0-0b2c-4eaf-b682-43e5e290b79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e36f5bc-922d-4dfe-9ecb-49ba6c855878", "name": "network-vif-deleted", "tag": "9e73391a-9d05-40e7-8c63-8913ccd9e1bc"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:22.559260 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-6b928354-55f8-439d-a515-872f52797ab0 req-509f4fb0-0b2c-4eaf-b682-43e5e290b79f service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:22.560043 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-6b928354-55f8-439d-a515-872f52797ab0 req-509f4fb0-0b2c-4eaf-b682-43e5e290b79f service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:22.574268 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-6b928354-55f8-439d-a515-872f52797ab0 req-509f4fb0-0b2c-4eaf-b682-43e5e290b79f service nova] Creating event network-vif-deleted:9e73391a-9d05-40e7-8c63-8913ccd9e1bc for instance 0e36f5bc-922d-4dfe-9ecb-49ba6c855878 on hv-cinder-83735 Jun 16 17:26:22.581703 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-6b928354-55f8-439d-a515-872f52797ab0 req-509f4fb0-0b2c-4eaf-b682-43e5e290b79f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037246 Jun 16 17:26:22.582565 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 242/471] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:26:22.588667 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-204d54bb-baf8-454f-8680-ecd82f56d1e5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:22.595609 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-204d54bb-baf8-454f-8680-ecd82f56d1e5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:22.596427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-204d54bb-baf8-454f-8680-ecd82f56d1e5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:22.611400 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f13456cb-94bf-44ad-9ed4-7cc462bf7018 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "POST /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.156328 Jun 16 17:26:22.612669 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 230/472] 10.222.0.66 () {60 vars in 1322 bytes} [Thu Jun 16 17:26:21 2022] POST /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54/os-volume_attachments => generated 194 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:26:22.624416 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-204d54bb-baf8-454f-8680-ecd82f56d1e5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Going to try to stop instance {{(pid=117553) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 17:26:22.670895 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-204d54bb-baf8-454f-8680-ecd82f56d1e5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "POST /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/action" status: 202 len: 0 microversion: 2.1 time: 0.086915 Jun 16 17:26:22.671873 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 243/473] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jun 16 17:26:22 2022] POST /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:26:22.680666 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c5e0253f-6eac-42e6-8bf4-eadea11e4a2d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:22.681514 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c5e0253f-6eac-42e6-8bf4-eadea11e4a2d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:22.687769 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c5e0253f-6eac-42e6-8bf4-eadea11e4a2d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:22.688219 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c5e0253f-6eac-42e6-8bf4-eadea11e4a2d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:22.688977 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c5e0253f-6eac-42e6-8bf4-eadea11e4a2d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:22.689428 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c5e0253f-6eac-42e6-8bf4-eadea11e4a2d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:22.731359 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-e1576655-301b-414c-bb1d-f173558062cf tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:22.732052 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-e1576655-301b-414c-bb1d-f173558062cf tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:22.739038 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e1576655-301b-414c-bb1d-f173558062cf tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:22.739624 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e1576655-301b-414c-bb1d-f173558062cf tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:22.740424 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e1576655-301b-414c-bb1d-f173558062cf tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:22.740849 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e1576655-301b-414c-bb1d-f173558062cf tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:22.839680 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c5e0253f-6eac-42e6-8bf4-eadea11e4a2d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:22.847981 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c5e0253f-6eac-42e6-8bf4-eadea11e4a2d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1677 microversion: 2.1 time: 0.171634 Jun 16 17:26:22.848627 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 231/474] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:22 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:22.887391 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e1576655-301b-414c-bb1d-f173558062cf tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:22.900182 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-e1576655-301b-414c-bb1d-f173558062cf tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.172713 Jun 16 17:26:22.900850 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 244/475] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:22 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:23.046036 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-1aef8329-871c-4946-8538-db557e692223 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:23.046898 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-1aef8329-871c-4946-8538-db557e692223 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:23.054137 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1aef8329-871c-4946-8538-db557e692223 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:23.055063 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1aef8329-871c-4946-8538-db557e692223 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:23.056121 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1aef8329-871c-4946-8538-db557e692223 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:23.056754 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1aef8329-871c-4946-8538-db557e692223 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:23.097687 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1aef8329-871c-4946-8538-db557e692223 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:23.098247 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1aef8329-871c-4946-8538-db557e692223 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:23.098747 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.objects.instance [None req-1aef8329-871c-4946-8538-db557e692223 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lazy-loading 'fault' on Instance uuid 0e36f5bc-922d-4dfe-9ecb-49ba6c855878 {{(pid=117552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:26:23.151414 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-1aef8329-871c-4946-8538-db557e692223 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:23.161534 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-1aef8329-871c-4946-8538-db557e692223 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 200 len: 1307 microversion: 2.1 time: 0.119713 Jun 16 17:26:23.162373 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 232/476] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:23 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 1307 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:23.226270 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b7433906-9d7e-4078-be8c-c9cf14f656d1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:23.226986 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-b7433906-9d7e-4078-be8c-c9cf14f656d1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:23.233200 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b7433906-9d7e-4078-be8c-c9cf14f656d1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:23.234338 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b7433906-9d7e-4078-be8c-c9cf14f656d1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:23.235052 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b7433906-9d7e-4078-be8c-c9cf14f656d1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:23.235481 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b7433906-9d7e-4078-be8c-c9cf14f656d1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:23.439222 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b7433906-9d7e-4078-be8c-c9cf14f656d1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:23.447807 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b7433906-9d7e-4078-be8c-c9cf14f656d1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1266 microversion: 2.1 time: 0.225382 Jun 16 17:26:23.448426 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 245/477] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:23 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:23.559936 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-32880fcd-b7fb-43c5-ae56-44c1597f8ec4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:23.561775 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-32880fcd-b7fb-43c5-ae56-44c1597f8ec4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:23.570634 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-32880fcd-b7fb-43c5-ae56-44c1597f8ec4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:23.571072 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-32880fcd-b7fb-43c5-ae56-44c1597f8ec4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:23.571834 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-32880fcd-b7fb-43c5-ae56-44c1597f8ec4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:23.572233 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-32880fcd-b7fb-43c5-ae56-44c1597f8ec4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:23.714429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-32880fcd-b7fb-43c5-ae56-44c1597f8ec4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:23.725972 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-32880fcd-b7fb-43c5-ae56-44c1597f8ec4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:23.727219 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-32880fcd-b7fb-43c5-ae56-44c1597f8ec4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:23.728417 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-32880fcd-b7fb-43c5-ae56-44c1597f8ec4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.172456 Jun 16 17:26:23.728982 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 233/478] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:23 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:23.867380 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-6e3648fa-9292-4376-bfe1-d58d03710c16 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:23.868163 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-6e3648fa-9292-4376-bfe1-d58d03710c16 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:23.874788 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6e3648fa-9292-4376-bfe1-d58d03710c16 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:23.875238 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6e3648fa-9292-4376-bfe1-d58d03710c16 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:23.876004 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6e3648fa-9292-4376-bfe1-d58d03710c16 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:23.876435 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6e3648fa-9292-4376-bfe1-d58d03710c16 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:23.919689 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-11d253e3-db80-4af9-b6e6-b067bced0d13 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:23.920382 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-11d253e3-db80-4af9-b6e6-b067bced0d13 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:23.927228 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-11d253e3-db80-4af9-b6e6-b067bced0d13 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:23.927686 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-11d253e3-db80-4af9-b6e6-b067bced0d13 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:23.928537 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-11d253e3-db80-4af9-b6e6-b067bced0d13 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:23.929078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-11d253e3-db80-4af9-b6e6-b067bced0d13 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:24.016735 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6e3648fa-9292-4376-bfe1-d58d03710c16 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:24.024424 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-6e3648fa-9292-4376-bfe1-d58d03710c16 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1677 microversion: 2.1 time: 0.161265 Jun 16 17:26:24.024990 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 246/479] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:23 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:24.066933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-11d253e3-db80-4af9-b6e6-b067bced0d13 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:24.075636 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-11d253e3-db80-4af9-b6e6-b067bced0d13 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.161269 Jun 16 17:26:24.076200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 234/480] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:23 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:24.181514 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b7b469fa-c5dd-4c30-85bb-a773481326af tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:24.182121 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-b7b469fa-c5dd-4c30-85bb-a773481326af tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 0e36f5bc-922d-4dfe-9ecb-49ba6c855878] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:24.191752 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b7b469fa-c5dd-4c30-85bb-a773481326af tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:24.192285 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b7b469fa-c5dd-4c30-85bb-a773481326af tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:24.193475 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b7b469fa-c5dd-4c30-85bb-a773481326af tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:24.194066 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b7b469fa-c5dd-4c30-85bb-a773481326af tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:24.207961 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-b7b469fa-c5dd-4c30-85bb-a773481326af tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] HTTP exception thrown: Instance 0e36f5bc-922d-4dfe-9ecb-49ba6c855878 could not be found. Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b7b469fa-c5dd-4c30-85bb-a773481326af tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Request method failure captured: Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 HTTP/1.1 Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2dkGjFW1K4vCbDuBs1cQR2QF8ujl-iguR-7NCtPY0ZiMl4v8DvbXwtMfGH5b6g96aIDObACJIbAovaAlTLwCQBK70Mt2dM44QeVjI6NBpsHzZWMMVPwl6WJ94-bWW_4MusLhcIfyR11WUHGruJaveiUF6JzUenaTo2ZHaSu4MSmlJU Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: f96239e8e212410aac9df2d35293c665 Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-VolumesSnapshotTestJSON-385000497 Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:26:24.209620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:26:24.211288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f96239e8e212410aac9df2d35293c665"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f96239e8e212410aac9df2d35293c665"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f96239e8e212410aac9df2d35293c665", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f96239e8e212410aac9df2d35293c665"}]}] Jun 16 17:26:24.211288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-VolumesSnapshotTestJSON-385000497 Jun 16 17:26:24.211288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: f96239e8e212410aac9df2d35293c665 Jun 16 17:26:24.211288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-385000497 Jun 16 17:26:24.211288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-VolumesSnapshotTestJSON-385000497-project Jun 16 17:26:24.211288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:26:24.211288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:26:24.211288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: 8b088ae5ce5046ae83d9ae151dc52eca Jun 16 17:26:24.211288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-VolumesSnapshotTestJSON-385000497-project Jun 16 17:26:24.211288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:26:24.211288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance 0e36f5bc-922d-4dfe-9ecb-49ba6c855878 could not be found. Jun 16 17:26:24.211288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': '0e36f5bc-922d-4dfe-9ecb-49ba6c855878'} Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e36f5bc-922d-4dfe-9ecb-49ba6c855878 could not be found. Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:26:24.212125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e36f5bc-922d-4dfe-9ecb-49ba6c855878 could not be found. Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e36f5bc-922d-4dfe-9ecb-49ba6c855878 could not be found. Jun 16 17:26:24.213623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:26:24.214942 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b7b469fa-c5dd-4c30-85bb-a773481326af tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Returning 404 to user: Instance 0e36f5bc-922d-4dfe-9ecb-49ba6c855878 could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:26:24.214942 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b7b469fa-c5dd-4c30-85bb-a773481326af tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878" status: 404 len: 111 microversion: 2.1 time: 0.034808 Jun 16 17:26:24.214942 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 247/481] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:24 2022] GET /compute/v2.1/servers/0e36f5bc-922d-4dfe-9ecb-49ba6c855878 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:26:24.466779 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f7f1d4e0-a141-4149-a9e7-c09bd4a80a7c tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:24.467487 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f7f1d4e0-a141-4149-a9e7-c09bd4a80a7c tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:24.473916 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f7f1d4e0-a141-4149-a9e7-c09bd4a80a7c tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:24.474481 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f7f1d4e0-a141-4149-a9e7-c09bd4a80a7c tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:24.476701 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f7f1d4e0-a141-4149-a9e7-c09bd4a80a7c tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:24.477608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f7f1d4e0-a141-4149-a9e7-c09bd4a80a7c tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:24.617121 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f7f1d4e0-a141-4149-a9e7-c09bd4a80a7c tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:24.624853 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f7f1d4e0-a141-4149-a9e7-c09bd4a80a7c tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1266 microversion: 2.1 time: 0.162031 Jun 16 17:26:24.625452 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 235/482] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:24 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:24.750165 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-0bfa7fad-0fbb-4362-bf26-485bed8c62d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:24.750980 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-0bfa7fad-0fbb-4362-bf26-485bed8c62d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:24.760040 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0bfa7fad-0fbb-4362-bf26-485bed8c62d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:24.760494 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0bfa7fad-0fbb-4362-bf26-485bed8c62d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:24.761273 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0bfa7fad-0fbb-4362-bf26-485bed8c62d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:24.761700 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0bfa7fad-0fbb-4362-bf26-485bed8c62d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:24.912925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0bfa7fad-0fbb-4362-bf26-485bed8c62d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:24.922732 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0bfa7fad-0fbb-4362-bf26-485bed8c62d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:24.924226 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0bfa7fad-0fbb-4362-bf26-485bed8c62d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:24.925415 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-0bfa7fad-0fbb-4362-bf26-485bed8c62d5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.181640 Jun 16 17:26:24.925983 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 248/483] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:24 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:25.042903 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b6fc765f-ef58-4dbb-bc7a-9faa603b83eb tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:25.043440 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b6fc765f-ef58-4dbb-bc7a-9faa603b83eb tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:25.050326 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b6fc765f-ef58-4dbb-bc7a-9faa603b83eb tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:25.050787 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b6fc765f-ef58-4dbb-bc7a-9faa603b83eb tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:25.051550 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b6fc765f-ef58-4dbb-bc7a-9faa603b83eb tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:25.051991 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b6fc765f-ef58-4dbb-bc7a-9faa603b83eb tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:25.093310 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2ab2978c-acc2-4ff4-a4d1-e99a0e7ae8c4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:25.094048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2ab2978c-acc2-4ff4-a4d1-e99a0e7ae8c4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:25.103812 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2ab2978c-acc2-4ff4-a4d1-e99a0e7ae8c4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:25.104259 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2ab2978c-acc2-4ff4-a4d1-e99a0e7ae8c4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:25.105454 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2ab2978c-acc2-4ff4-a4d1-e99a0e7ae8c4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:25.106004 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2ab2978c-acc2-4ff4-a4d1-e99a0e7ae8c4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:25.199807 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-b6fc765f-ef58-4dbb-bc7a-9faa603b83eb tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:25.207894 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b6fc765f-ef58-4dbb-bc7a-9faa603b83eb tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1677 microversion: 2.1 time: 0.169374 Jun 16 17:26:25.208467 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 236/484] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:25 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:25.243056 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2ab2978c-acc2-4ff4-a4d1-e99a0e7ae8c4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:25.251236 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2ab2978c-acc2-4ff4-a4d1-e99a0e7ae8c4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.161914 Jun 16 17:26:25.251823 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 249/485] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:25 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:25.643236 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a6fc6973-7927-4a6f-b66d-01c8e6da232a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:25.643895 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a6fc6973-7927-4a6f-b66d-01c8e6da232a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:25.653221 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a6fc6973-7927-4a6f-b66d-01c8e6da232a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:25.653978 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a6fc6973-7927-4a6f-b66d-01c8e6da232a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:25.654795 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a6fc6973-7927-4a6f-b66d-01c8e6da232a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:25.655251 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a6fc6973-7927-4a6f-b66d-01c8e6da232a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:25.798992 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a6fc6973-7927-4a6f-b66d-01c8e6da232a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:25.801422 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:25.808498 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a6fc6973-7927-4a6f-b66d-01c8e6da232a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1266 microversion: 2.1 time: 0.170341 Jun 16 17:26:25.809241 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 237/486] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:25 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:25.946621 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2dd63cda-8e3a-4e03-b56d-c3805de6522d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:25.947176 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2dd63cda-8e3a-4e03-b56d-c3805de6522d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:25.957480 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2dd63cda-8e3a-4e03-b56d-c3805de6522d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:25.958033 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2dd63cda-8e3a-4e03-b56d-c3805de6522d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:25.959107 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2dd63cda-8e3a-4e03-b56d-c3805de6522d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:25.959530 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2dd63cda-8e3a-4e03-b56d-c3805de6522d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:26.099538 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2dd63cda-8e3a-4e03-b56d-c3805de6522d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:26.112681 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2dd63cda-8e3a-4e03-b56d-c3805de6522d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:26.115202 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2dd63cda-8e3a-4e03-b56d-c3805de6522d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:26.116997 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2dd63cda-8e3a-4e03-b56d-c3805de6522d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.176352 Jun 16 17:26:26.117578 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 250/487] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:25 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:26.225477 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-dad1d2f9-12ad-4788-bd8a-c6c488bdff2c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:26.226106 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-dad1d2f9-12ad-4788-bd8a-c6c488bdff2c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:26.234484 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-dad1d2f9-12ad-4788-bd8a-c6c488bdff2c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:26.234919 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-dad1d2f9-12ad-4788-bd8a-c6c488bdff2c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:26.235705 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-dad1d2f9-12ad-4788-bd8a-c6c488bdff2c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:26.236187 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-dad1d2f9-12ad-4788-bd8a-c6c488bdff2c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:26.268054 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f135db2a-aa0c-4776-b015-0f63378a3b16 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:26.268759 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f135db2a-aa0c-4776-b015-0f63378a3b16 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:26.275680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f135db2a-aa0c-4776-b015-0f63378a3b16 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:26.276123 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f135db2a-aa0c-4776-b015-0f63378a3b16 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:26.276893 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f135db2a-aa0c-4776-b015-0f63378a3b16 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:26.277355 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f135db2a-aa0c-4776-b015-0f63378a3b16 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:26.381904 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-dad1d2f9-12ad-4788-bd8a-c6c488bdff2c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:26.390014 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-dad1d2f9-12ad-4788-bd8a-c6c488bdff2c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1677 microversion: 2.1 time: 0.168433 Jun 16 17:26:26.390698 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 238/488] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:26 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:26.423224 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-f135db2a-aa0c-4776-b015-0f63378a3b16 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:26.432512 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f135db2a-aa0c-4776-b015-0f63378a3b16 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.168219 Jun 16 17:26:26.433068 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 251/489] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:26 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:26.827726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-684f2379-7db2-4baf-b49f-3eb2a154547c tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:26.828256 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-684f2379-7db2-4baf-b49f-3eb2a154547c tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:26.837477 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-684f2379-7db2-4baf-b49f-3eb2a154547c tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:26.837925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-684f2379-7db2-4baf-b49f-3eb2a154547c tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:26.838680 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-684f2379-7db2-4baf-b49f-3eb2a154547c tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:26.839111 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-684f2379-7db2-4baf-b49f-3eb2a154547c tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:26.984967 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-684f2379-7db2-4baf-b49f-3eb2a154547c tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:26.996083 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-684f2379-7db2-4baf-b49f-3eb2a154547c tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1266 microversion: 2.1 time: 0.173714 Jun 16 17:26:26.996692 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 239/490] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:26 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:27.135889 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-72c208d4-f689-44c6-b3d7-ed4caa54d92a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:27.136450 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-72c208d4-f689-44c6-b3d7-ed4caa54d92a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:27.139185 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:27.144952 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-72c208d4-f689-44c6-b3d7-ed4caa54d92a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:27.145404 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-72c208d4-f689-44c6-b3d7-ed4caa54d92a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:27.146200 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-72c208d4-f689-44c6-b3d7-ed4caa54d92a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:27.146629 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-72c208d4-f689-44c6-b3d7-ed4caa54d92a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:27.304363 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-72c208d4-f689-44c6-b3d7-ed4caa54d92a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:27.321289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-72c208d4-f689-44c6-b3d7-ed4caa54d92a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:27.322842 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-72c208d4-f689-44c6-b3d7-ed4caa54d92a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:27.324012 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-72c208d4-f689-44c6-b3d7-ed4caa54d92a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.192618 Jun 16 17:26:27.324636 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 252/491] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:27 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:27.408012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-270ec46c-0576-421f-9153-fae68133118c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:27.408563 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-270ec46c-0576-421f-9153-fae68133118c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:27.415188 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-270ec46c-0576-421f-9153-fae68133118c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:27.415640 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-270ec46c-0576-421f-9153-fae68133118c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:27.416400 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-270ec46c-0576-421f-9153-fae68133118c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:27.416827 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-270ec46c-0576-421f-9153-fae68133118c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:27.451446 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-14e79dce-1f53-42a8-bd35-b81abc50d36a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:27.452572 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-14e79dce-1f53-42a8-bd35-b81abc50d36a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:27.460782 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-14e79dce-1f53-42a8-bd35-b81abc50d36a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:27.461379 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-14e79dce-1f53-42a8-bd35-b81abc50d36a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:27.462925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-14e79dce-1f53-42a8-bd35-b81abc50d36a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:27.462925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-14e79dce-1f53-42a8-bd35-b81abc50d36a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:27.467981 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:27.588611 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-270ec46c-0576-421f-9153-fae68133118c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:27.597758 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-270ec46c-0576-421f-9153-fae68133118c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1677 microversion: 2.1 time: 0.193604 Jun 16 17:26:27.598525 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 240/492] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:27 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:27.640113 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-14e79dce-1f53-42a8-bd35-b81abc50d36a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:27.650038 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-14e79dce-1f53-42a8-bd35-b81abc50d36a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.203467 Jun 16 17:26:27.651703 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 253/493] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:27 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:28.018399 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-047eafee-62e3-4d52-aa60-f7c61e1b8dc9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:28.018642 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-047eafee-62e3-4d52-aa60-f7c61e1b8dc9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:28.026609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-047eafee-62e3-4d52-aa60-f7c61e1b8dc9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:28.027050 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-047eafee-62e3-4d52-aa60-f7c61e1b8dc9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:28.027848 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-047eafee-62e3-4d52-aa60-f7c61e1b8dc9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:28.028280 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-047eafee-62e3-4d52-aa60-f7c61e1b8dc9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:28.174255 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-047eafee-62e3-4d52-aa60-f7c61e1b8dc9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:28.183928 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-047eafee-62e3-4d52-aa60-f7c61e1b8dc9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1266 microversion: 2.1 time: 0.170166 Jun 16 17:26:28.184519 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 241/494] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:28 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:28.346288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a4cfb159-00da-4570-ba01-96742b482ae1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:28.347174 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a4cfb159-00da-4570-ba01-96742b482ae1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:28.355905 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a4cfb159-00da-4570-ba01-96742b482ae1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:28.356344 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a4cfb159-00da-4570-ba01-96742b482ae1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:28.357118 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a4cfb159-00da-4570-ba01-96742b482ae1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:28.357742 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a4cfb159-00da-4570-ba01-96742b482ae1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:28.503475 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a4cfb159-00da-4570-ba01-96742b482ae1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:28.512722 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a4cfb159-00da-4570-ba01-96742b482ae1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:28.514241 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a4cfb159-00da-4570-ba01-96742b482ae1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:28.515485 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a4cfb159-00da-4570-ba01-96742b482ae1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.173429 Jun 16 17:26:28.516038 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 254/495] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:28 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:28.615753 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0ddb44d4-7056-466f-86c4-f6451052e71c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:28.616356 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0ddb44d4-7056-466f-86c4-f6451052e71c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:28.622951 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0ddb44d4-7056-466f-86c4-f6451052e71c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:28.623394 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0ddb44d4-7056-466f-86c4-f6451052e71c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:28.624151 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0ddb44d4-7056-466f-86c4-f6451052e71c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:28.624576 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0ddb44d4-7056-466f-86c4-f6451052e71c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:28.670179 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-06e79a34-6c2d-4606-857e-5d87e8fd677b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:28.670891 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-06e79a34-6c2d-4606-857e-5d87e8fd677b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:28.677732 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-06e79a34-6c2d-4606-857e-5d87e8fd677b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:28.678168 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-06e79a34-6c2d-4606-857e-5d87e8fd677b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:28.678953 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-06e79a34-6c2d-4606-857e-5d87e8fd677b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:28.679449 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-06e79a34-6c2d-4606-857e-5d87e8fd677b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:28.762539 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0ddb44d4-7056-466f-86c4-f6451052e71c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:28.771155 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0ddb44d4-7056-466f-86c4-f6451052e71c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1677 microversion: 2.1 time: 0.159258 Jun 16 17:26:28.771755 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 242/496] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:28 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:28.839753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-06e79a34-6c2d-4606-857e-5d87e8fd677b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:28.848415 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-06e79a34-6c2d-4606-857e-5d87e8fd677b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.182126 Jun 16 17:26:28.848992 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 255/497] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:28 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:29.200908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-3e11304f-16e5-48a3-bb97-a375e19a4000 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:29.201538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-3e11304f-16e5-48a3-bb97-a375e19a4000 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:29.208552 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3e11304f-16e5-48a3-bb97-a375e19a4000 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:29.208908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3e11304f-16e5-48a3-bb97-a375e19a4000 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:29.209698 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3e11304f-16e5-48a3-bb97-a375e19a4000 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:29.210156 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3e11304f-16e5-48a3-bb97-a375e19a4000 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:29.358122 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-3e11304f-16e5-48a3-bb97-a375e19a4000 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:29.366409 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-3e11304f-16e5-48a3-bb97-a375e19a4000 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1266 microversion: 2.1 time: 0.169437 Jun 16 17:26:29.367650 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 243/498] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:29 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:29.534942 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ef7bc528-4d47-4de6-beac-e5bf7d5d0226 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:29.535687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ef7bc528-4d47-4de6-beac-e5bf7d5d0226 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:29.537736 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:29.544340 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ef7bc528-4d47-4de6-beac-e5bf7d5d0226 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:29.544774 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ef7bc528-4d47-4de6-beac-e5bf7d5d0226 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:29.545751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ef7bc528-4d47-4de6-beac-e5bf7d5d0226 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:29.546168 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ef7bc528-4d47-4de6-beac-e5bf7d5d0226 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:29.688645 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ef7bc528-4d47-4de6-beac-e5bf7d5d0226 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:29.700648 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ef7bc528-4d47-4de6-beac-e5bf7d5d0226 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:29.703137 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ef7bc528-4d47-4de6-beac-e5bf7d5d0226 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:29.704943 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ef7bc528-4d47-4de6-beac-e5bf7d5d0226 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.174205 Jun 16 17:26:29.705762 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 256/499] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:29 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:29.789633 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-6a7855ac-c3d0-4fb1-bbee-79ffd6b40f5a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:29.790204 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-6a7855ac-c3d0-4fb1-bbee-79ffd6b40f5a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:29.796606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6a7855ac-c3d0-4fb1-bbee-79ffd6b40f5a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:29.797056 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6a7855ac-c3d0-4fb1-bbee-79ffd6b40f5a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:29.798059 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6a7855ac-c3d0-4fb1-bbee-79ffd6b40f5a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:29.798621 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6a7855ac-c3d0-4fb1-bbee-79ffd6b40f5a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:29.869867 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-6bfc5c4b-1304-4924-9ee4-c2f4cc82f0c3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:29.869867 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-6bfc5c4b-1304-4924-9ee4-c2f4cc82f0c3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:29.874792 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6bfc5c4b-1304-4924-9ee4-c2f4cc82f0c3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:29.875240 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6bfc5c4b-1304-4924-9ee4-c2f4cc82f0c3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:29.876013 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6bfc5c4b-1304-4924-9ee4-c2f4cc82f0c3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:29.876440 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6bfc5c4b-1304-4924-9ee4-c2f4cc82f0c3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:29.939619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-6a7855ac-c3d0-4fb1-bbee-79ffd6b40f5a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:29.947869 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-6a7855ac-c3d0-4fb1-bbee-79ffd6b40f5a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1677 microversion: 2.1 time: 0.162656 Jun 16 17:26:29.957777 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 244/500] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:29 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:30.017145 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6bfc5c4b-1304-4924-9ee4-c2f4cc82f0c3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:30.025621 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-6bfc5c4b-1304-4924-9ee4-c2f4cc82f0c3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.162635 Jun 16 17:26:30.026189 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 257/501] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:29 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:30.331920 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-7069f906-cabd-4d6c-9d4e-314b5579d8b7 req-512b0396-b318-4120-9266-dc071c464e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2e7148-fa86-4648-9e4b-87e27fcf1147", "name": "network-vif-plugged", "status": "completed", "tag": "2da50d5c-d328-4853-a261-6bd0c6378dcd"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:30.341028 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-7069f906-cabd-4d6c-9d4e-314b5579d8b7 req-512b0396-b318-4120-9266-dc071c464e38 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:30.341558 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-7069f906-cabd-4d6c-9d4e-314b5579d8b7 req-512b0396-b318-4120-9266-dc071c464e38 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:30.356480 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-7069f906-cabd-4d6c-9d4e-314b5579d8b7 req-512b0396-b318-4120-9266-dc071c464e38 service nova] Creating event network-vif-plugged:2da50d5c-d328-4853-a261-6bd0c6378dcd for instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 on hv-cinder-83735 Jun 16 17:26:30.362047 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-7069f906-cabd-4d6c-9d4e-314b5579d8b7 req-512b0396-b318-4120-9266-dc071c464e38 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033820 Jun 16 17:26:30.362746 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 245/502] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:26:30.384755 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-df57acbd-f581-4a1a-b5cc-1d667943bad9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:30.385676 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-df57acbd-f581-4a1a-b5cc-1d667943bad9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:30.392168 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-df57acbd-f581-4a1a-b5cc-1d667943bad9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:30.392609 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-df57acbd-f581-4a1a-b5cc-1d667943bad9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:30.393428 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-df57acbd-f581-4a1a-b5cc-1d667943bad9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:30.393835 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-df57acbd-f581-4a1a-b5cc-1d667943bad9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:30.562946 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-df57acbd-f581-4a1a-b5cc-1d667943bad9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:30.574936 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-df57acbd-f581-4a1a-b5cc-1d667943bad9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1266 microversion: 2.1 time: 0.194570 Jun 16 17:26:30.575588 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 258/503] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:30 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:30.729255 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c48929e9-d7b8-4d7c-8864-af36db35e311 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:30.729984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c48929e9-d7b8-4d7c-8864-af36db35e311 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:30.739573 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c48929e9-d7b8-4d7c-8864-af36db35e311 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:30.740225 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c48929e9-d7b8-4d7c-8864-af36db35e311 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:30.741384 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c48929e9-d7b8-4d7c-8864-af36db35e311 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:30.742340 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c48929e9-d7b8-4d7c-8864-af36db35e311 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:30.899035 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c48929e9-d7b8-4d7c-8864-af36db35e311 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:30.907640 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c48929e9-d7b8-4d7c-8864-af36db35e311 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:30.909110 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c48929e9-d7b8-4d7c-8864-af36db35e311 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:30.910260 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c48929e9-d7b8-4d7c-8864-af36db35e311 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.188844 Jun 16 17:26:30.910804 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 246/504] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:30 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:30.968520 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-921f0121-15ce-4238-84f9-cd4b79ad9aa1 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:30.969131 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-921f0121-15ce-4238-84f9-cd4b79ad9aa1 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:30.975816 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-921f0121-15ce-4238-84f9-cd4b79ad9aa1 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:30.976385 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-921f0121-15ce-4238-84f9-cd4b79ad9aa1 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:30.977156 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-921f0121-15ce-4238-84f9-cd4b79ad9aa1 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:30.977594 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-921f0121-15ce-4238-84f9-cd4b79ad9aa1 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:31.044131 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7da3c5bf-66ce-42ad-879c-d09418bcbf6e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:31.044749 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7da3c5bf-66ce-42ad-879c-d09418bcbf6e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:31.052753 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7da3c5bf-66ce-42ad-879c-d09418bcbf6e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:31.053209 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7da3c5bf-66ce-42ad-879c-d09418bcbf6e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:31.054425 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7da3c5bf-66ce-42ad-879c-d09418bcbf6e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:31.054818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7da3c5bf-66ce-42ad-879c-d09418bcbf6e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:31.136455 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-921f0121-15ce-4238-84f9-cd4b79ad9aa1 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:31.145387 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-921f0121-15ce-4238-84f9-cd4b79ad9aa1 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1677 microversion: 2.1 time: 0.181642 Jun 16 17:26:31.145892 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 259/505] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:30 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:31.227389 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7da3c5bf-66ce-42ad-879c-d09418bcbf6e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:31.237606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7da3c5bf-66ce-42ad-879c-d09418bcbf6e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.197136 Jun 16 17:26:31.238199 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 247/506] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:31 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:31.596376 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ce192d93-3b3f-45c4-a3b4-a3051d4f252f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:31.597018 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ce192d93-3b3f-45c4-a3b4-a3051d4f252f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:31.605721 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ce192d93-3b3f-45c4-a3b4-a3051d4f252f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:31.606258 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ce192d93-3b3f-45c4-a3b4-a3051d4f252f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:31.607039 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ce192d93-3b3f-45c4-a3b4-a3051d4f252f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:31.607459 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ce192d93-3b3f-45c4-a3b4-a3051d4f252f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:31.761809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ce192d93-3b3f-45c4-a3b4-a3051d4f252f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:31.778873 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ce192d93-3b3f-45c4-a3b4-a3051d4f252f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1266 microversion: 2.1 time: 0.186708 Jun 16 17:26:31.779487 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 260/507] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:31 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:31.931665 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-1b2b918b-8aaf-4abb-a3c9-373c99166988 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:31.932324 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-1b2b918b-8aaf-4abb-a3c9-373c99166988 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:31.939252 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1b2b918b-8aaf-4abb-a3c9-373c99166988 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:31.939696 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1b2b918b-8aaf-4abb-a3c9-373c99166988 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:31.940452 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1b2b918b-8aaf-4abb-a3c9-373c99166988 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:31.940875 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1b2b918b-8aaf-4abb-a3c9-373c99166988 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:32.083133 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-1b2b918b-8aaf-4abb-a3c9-373c99166988 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:32.092746 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-1b2b918b-8aaf-4abb-a3c9-373c99166988 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:32.094306 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-1b2b918b-8aaf-4abb-a3c9-373c99166988 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:32.095456 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-1b2b918b-8aaf-4abb-a3c9-373c99166988 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.168554 Jun 16 17:26:32.096006 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 248/508] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:31 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:32.167325 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-9fd0a25a-5497-4eeb-b5b7-455b37ce051b tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:32.167930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-9fd0a25a-5497-4eeb-b5b7-455b37ce051b tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:32.175599 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9fd0a25a-5497-4eeb-b5b7-455b37ce051b tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:32.176039 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9fd0a25a-5497-4eeb-b5b7-455b37ce051b tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:32.177069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9fd0a25a-5497-4eeb-b5b7-455b37ce051b tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:32.177587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9fd0a25a-5497-4eeb-b5b7-455b37ce051b tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:32.255213 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d5d8bcaf-680f-4473-97de-b7fb1737bfcd tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:32.256125 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d5d8bcaf-680f-4473-97de-b7fb1737bfcd tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:32.262288 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d5d8bcaf-680f-4473-97de-b7fb1737bfcd tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:32.262726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d5d8bcaf-680f-4473-97de-b7fb1737bfcd tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:32.263462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d5d8bcaf-680f-4473-97de-b7fb1737bfcd tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:32.263881 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d5d8bcaf-680f-4473-97de-b7fb1737bfcd tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:32.317706 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-9fd0a25a-5497-4eeb-b5b7-455b37ce051b tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:32.325890 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-9fd0a25a-5497-4eeb-b5b7-455b37ce051b tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1677 microversion: 2.1 time: 0.164929 Jun 16 17:26:32.326867 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 261/509] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:32 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:32.405744 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d5d8bcaf-680f-4473-97de-b7fb1737bfcd tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:32.416459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d5d8bcaf-680f-4473-97de-b7fb1737bfcd tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.165090 Jun 16 17:26:32.417078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 249/510] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:32 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:32.798664 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-667af3f1-af2c-4230-86a6-b625b2c7496b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:32.799273 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-667af3f1-af2c-4230-86a6-b625b2c7496b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:32.806616 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-667af3f1-af2c-4230-86a6-b625b2c7496b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:32.807051 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-667af3f1-af2c-4230-86a6-b625b2c7496b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:32.807812 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-667af3f1-af2c-4230-86a6-b625b2c7496b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:32.808230 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-667af3f1-af2c-4230-86a6-b625b2c7496b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:32.966560 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-667af3f1-af2c-4230-86a6-b625b2c7496b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:32.975039 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-667af3f1-af2c-4230-86a6-b625b2c7496b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1266 microversion: 2.1 time: 0.180207 Jun 16 17:26:32.975796 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 262/511] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:32 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:33.114269 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-29f501b2-0e06-42d5-9bbc-e0ca4c427872 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:33.114857 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-29f501b2-0e06-42d5-9bbc-e0ca4c427872 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:33.122013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-29f501b2-0e06-42d5-9bbc-e0ca4c427872 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:33.122469 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-29f501b2-0e06-42d5-9bbc-e0ca4c427872 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:33.123279 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-29f501b2-0e06-42d5-9bbc-e0ca4c427872 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:33.123674 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-29f501b2-0e06-42d5-9bbc-e0ca4c427872 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:33.196289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f505c377-ed2a-4326-aaea-324cf04c09b6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-665453650", "imageRef": "c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1", "flavorRef": "452", "networks": [{"uuid": "184a3d80-6b15-43ef-84b8-ddb86570078c"}]}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:33.261691 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.network.neutron [None req-f505c377-ed2a-4326-aaea-324cf04c09b6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] validate_networks() for [('184a3d80-6b15-43ef-84b8-ddb86570078c', None, None, None, None, None)] {{(pid=117553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:26:33.271198 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-29f501b2-0e06-42d5-9bbc-e0ca4c427872 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:33.286341 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-29f501b2-0e06-42d5-9bbc-e0ca4c427872 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:33.288047 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-29f501b2-0e06-42d5-9bbc-e0ca4c427872 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:33.289564 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-29f501b2-0e06-42d5-9bbc-e0ca4c427872 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.179520 Jun 16 17:26:33.290122 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 250/512] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:33 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:33.347868 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5575a946-0549-453b-b076-ceb73b951144 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:33.348670 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-5575a946-0549-453b-b076-ceb73b951144 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:33.355874 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5575a946-0549-453b-b076-ceb73b951144 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:33.356289 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5575a946-0549-453b-b076-ceb73b951144 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:33.357124 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5575a946-0549-453b-b076-ceb73b951144 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:33.358043 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5575a946-0549-453b-b076-ceb73b951144 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:33.633355 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5575a946-0549-453b-b076-ceb73b951144 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:33.651147 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-5575a946-0549-453b-b076-ceb73b951144 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1677 microversion: 2.1 time: 0.309596 Jun 16 17:26:33.652515 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 251/513] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:33 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1677 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:33.658674 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-289bddb1-b844-4501-b543-0515a4935fea tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:33.659542 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-289bddb1-b844-4501-b543-0515a4935fea tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:33.670410 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-289bddb1-b844-4501-b543-0515a4935fea tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:33.671296 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-289bddb1-b844-4501-b543-0515a4935fea tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:33.672743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-289bddb1-b844-4501-b543-0515a4935fea tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:33.674479 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-289bddb1-b844-4501-b543-0515a4935fea tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:33.948133 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-f505c377-ed2a-4326-aaea-324cf04c09b6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Flavor limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:26:33.949356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-f505c377-ed2a-4326-aaea-324cf04c09b6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Image limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:26:33.949932 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-f505c377-ed2a-4326-aaea-324cf04c09b6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Flavor pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:26:33.950879 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-f505c377-ed2a-4326-aaea-324cf04c09b6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Image pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:26:33.951301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-f505c377-ed2a-4326-aaea-324cf04c09b6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:26:33.962820 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-289bddb1-b844-4501-b543-0515a4935fea tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:33.963116 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f505c377-ed2a-4326-aaea-324cf04c09b6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:33.963661 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f505c377-ed2a-4326-aaea-324cf04c09b6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:33.964700 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f505c377-ed2a-4326-aaea-324cf04c09b6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:33.965152 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f505c377-ed2a-4326-aaea-324cf04c09b6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:33.972990 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-289bddb1-b844-4501-b543-0515a4935fea tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.318957 Jun 16 17:26:33.973692 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 252/514] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:33 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:33.979197 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d8940658-b208-4b58-b024-e611a2b8e1cb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:33.979813 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d8940658-b208-4b58-b024-e611a2b8e1cb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:33.992698 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d8940658-b208-4b58-b024-e611a2b8e1cb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:33.993148 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d8940658-b208-4b58-b024-e611a2b8e1cb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:33.994111 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d8940658-b208-4b58-b024-e611a2b8e1cb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:33.994546 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d8940658-b208-4b58-b024-e611a2b8e1cb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:33.996475 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-f505c377-ed2a-4326-aaea-324cf04c09b6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Getting quotas for project f96239e8e212410aac9df2d35293c665. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:26:34.000662 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-f505c377-ed2a-4326-aaea-324cf04c09b6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Getting quotas for user 8b088ae5ce5046ae83d9ae151dc52eca and project f96239e8e212410aac9df2d35293c665. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:26:34.012895 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f505c377-ed2a-4326-aaea-324cf04c09b6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Going to run 1 instances... {{(pid=117553) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:26:34.016139 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f505c377-ed2a-4326-aaea-324cf04c09b6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:26:34.085953 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f505c377-ed2a-4326-aaea-324cf04c09b6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893756 Jun 16 17:26:34.086854 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 263/515] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:26:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 17:26:34.093305 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-38a3f028-ad71-4f41-9b6e-7f1f3282c066 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:34.094169 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-38a3f028-ad71-4f41-9b6e-7f1f3282c066 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:34.101903 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-38a3f028-ad71-4f41-9b6e-7f1f3282c066 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:34.102616 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-38a3f028-ad71-4f41-9b6e-7f1f3282c066 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:34.104425 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-38a3f028-ad71-4f41-9b6e-7f1f3282c066 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:34.106058 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-38a3f028-ad71-4f41-9b6e-7f1f3282c066 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:34.177419 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d8940658-b208-4b58-b024-e611a2b8e1cb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:34.187195 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d8940658-b208-4b58-b024-e611a2b8e1cb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1595 microversion: 2.1 time: 0.212435 Jun 16 17:26:34.187776 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 253/516] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:33 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1595 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:34.195573 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8706f52d-e2af-47d0-82c6-79c0818922bf tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:34.196602 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8706f52d-e2af-47d0-82c6-79c0818922bf tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:34.283321 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8706f52d-e2af-47d0-82c6-79c0818922bf tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:34.291810 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8706f52d-e2af-47d0-82c6-79c0818922bf tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1218 microversion: 2.1 time: 0.102540 Jun 16 17:26:34.292444 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 254/517] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:34 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:34.316204 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-2a190458-8563-4c16-9eda-1ffa2993e2ed tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:34.317554 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-2a190458-8563-4c16-9eda-1ffa2993e2ed tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:34.328208 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2a190458-8563-4c16-9eda-1ffa2993e2ed tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:34.328666 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2a190458-8563-4c16-9eda-1ffa2993e2ed tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:34.329883 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2a190458-8563-4c16-9eda-1ffa2993e2ed tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:34.330605 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2a190458-8563-4c16-9eda-1ffa2993e2ed tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:34.477231 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-38a3f028-ad71-4f41-9b6e-7f1f3282c066 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:34.487201 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-38a3f028-ad71-4f41-9b6e-7f1f3282c066 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1266 microversion: 2.1 time: 0.399120 Jun 16 17:26:34.488202 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 264/518] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:34 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1266 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:34.561992 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2a190458-8563-4c16-9eda-1ffa2993e2ed tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:34.575355 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2a190458-8563-4c16-9eda-1ffa2993e2ed tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:34.577055 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2a190458-8563-4c16-9eda-1ffa2993e2ed tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:34.578557 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-2a190458-8563-4c16-9eda-1ffa2993e2ed tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.271882 Jun 16 17:26:34.579237 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 255/519] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:34 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:34.671514 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-40fee7cc-f3fa-4a91-88ba-caeb3b9810fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:34.672387 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-40fee7cc-f3fa-4a91-88ba-caeb3b9810fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:34.681036 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-40fee7cc-f3fa-4a91-88ba-caeb3b9810fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:34.681528 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-40fee7cc-f3fa-4a91-88ba-caeb3b9810fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:34.682370 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-40fee7cc-f3fa-4a91-88ba-caeb3b9810fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:34.682800 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-40fee7cc-f3fa-4a91-88ba-caeb3b9810fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:34.993931 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-80d96f0d-4f7f-47b2-9a51-6a930066ced5 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:34.994585 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-80d96f0d-4f7f-47b2-9a51-6a930066ced5 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:35.010222 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-80d96f0d-4f7f-47b2-9a51-6a930066ced5 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:35.010962 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-80d96f0d-4f7f-47b2-9a51-6a930066ced5 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:35.011888 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-80d96f0d-4f7f-47b2-9a51-6a930066ced5 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:35.012465 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-80d96f0d-4f7f-47b2-9a51-6a930066ced5 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:35.015799 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=100 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:35.036456 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-40fee7cc-f3fa-4a91-88ba-caeb3b9810fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:35.058823 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-40fee7cc-f3fa-4a91-88ba-caeb3b9810fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1677 microversion: 2.1 time: 0.392496 Jun 16 17:26:35.060740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 265/520] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:34 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1677 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:35.177604 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-80d96f0d-4f7f-47b2-9a51-6a930066ced5 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:35.197772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-80d96f0d-4f7f-47b2-9a51-6a930066ced5 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.208198 Jun 16 17:26:35.199172 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 256/521] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:34 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:35.314324 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7dd511f9-a534-4b48-a2b9-af9949db7a0e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:35.314867 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-7dd511f9-a534-4b48-a2b9-af9949db7a0e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:35.322448 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7dd511f9-a534-4b48-a2b9-af9949db7a0e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:35.322990 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7dd511f9-a534-4b48-a2b9-af9949db7a0e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:35.323695 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7dd511f9-a534-4b48-a2b9-af9949db7a0e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:35.324153 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7dd511f9-a534-4b48-a2b9-af9949db7a0e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:35.428152 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7dd511f9-a534-4b48-a2b9-af9949db7a0e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:35.443391 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7dd511f9-a534-4b48-a2b9-af9949db7a0e tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1270 microversion: 2.1 time: 0.132892 Jun 16 17:26:35.444511 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 266/522] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:35 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1270 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:35.505445 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ef286ccd-edd9-4388-8228-16ce1a50f274 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:35.506030 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ef286ccd-edd9-4388-8228-16ce1a50f274 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:35.514586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ef286ccd-edd9-4388-8228-16ce1a50f274 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:35.515181 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ef286ccd-edd9-4388-8228-16ce1a50f274 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:35.516083 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ef286ccd-edd9-4388-8228-16ce1a50f274 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:35.516514 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ef286ccd-edd9-4388-8228-16ce1a50f274 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:35.602777 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-702d425d-ef99-4f7a-8e34-ba67b78663b8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:35.603675 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-702d425d-ef99-4f7a-8e34-ba67b78663b8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:35.613613 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-702d425d-ef99-4f7a-8e34-ba67b78663b8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:35.614865 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-702d425d-ef99-4f7a-8e34-ba67b78663b8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:35.616816 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-702d425d-ef99-4f7a-8e34-ba67b78663b8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:35.617456 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-702d425d-ef99-4f7a-8e34-ba67b78663b8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:35.777545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ef286ccd-edd9-4388-8228-16ce1a50f274 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:35.791625 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ef286ccd-edd9-4388-8228-16ce1a50f274 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1266 microversion: 2.1 time: 0.289681 Jun 16 17:26:35.806556 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 257/523] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:35 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:35.814780 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-cfceb359-5491-4712-b976-13d11334b152 req-35c21320-ce9d-4e67-baae-4a5001de9aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157a0c77-c88e-4ef0-aef5-6ba851b57d00", "name": "network-vif-plugged", "status": "completed", "tag": "0fdde9ef-e61f-4c66-9976-8477640c42a6"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:35.825725 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=100 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:35.838340 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-cfceb359-5491-4712-b976-13d11334b152 req-35c21320-ce9d-4e67-baae-4a5001de9aba service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:35.840041 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-cfceb359-5491-4712-b976-13d11334b152 req-35c21320-ce9d-4e67-baae-4a5001de9aba service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:35.863843 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-cfceb359-5491-4712-b976-13d11334b152 req-35c21320-ce9d-4e67-baae-4a5001de9aba service nova] Creating event network-vif-plugged:0fdde9ef-e61f-4c66-9976-8477640c42a6 for instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 on hv-cinder-83735 Jun 16 17:26:35.872729 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-cfceb359-5491-4712-b976-13d11334b152 req-35c21320-ce9d-4e67-baae-4a5001de9aba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063941 Jun 16 17:26:35.874086 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 258/524] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:26:35.924988 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-702d425d-ef99-4f7a-8e34-ba67b78663b8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:35.944323 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-702d425d-ef99-4f7a-8e34-ba67b78663b8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:35.946483 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-702d425d-ef99-4f7a-8e34-ba67b78663b8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:35.947875 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-702d425d-ef99-4f7a-8e34-ba67b78663b8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.349258 Jun 16 17:26:35.954905 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 267/525] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:35 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:26:36.080565 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d373008d-de77-442f-a7c6-607d50f2ac13 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:36.081306 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d373008d-de77-442f-a7c6-607d50f2ac13 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:36.088381 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d373008d-de77-442f-a7c6-607d50f2ac13 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:36.089100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d373008d-de77-442f-a7c6-607d50f2ac13 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:36.090106 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d373008d-de77-442f-a7c6-607d50f2ac13 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:36.090570 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d373008d-de77-442f-a7c6-607d50f2ac13 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:36.221146 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a6219f78-8b09-4e0d-8207-0fc50261defc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:36.222123 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a6219f78-8b09-4e0d-8207-0fc50261defc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:36.230427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a6219f78-8b09-4e0d-8207-0fc50261defc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:36.231168 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a6219f78-8b09-4e0d-8207-0fc50261defc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:36.232152 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a6219f78-8b09-4e0d-8207-0fc50261defc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:36.232588 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a6219f78-8b09-4e0d-8207-0fc50261defc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:36.298867 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d373008d-de77-442f-a7c6-607d50f2ac13 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:36.317059 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d373008d-de77-442f-a7c6-607d50f2ac13 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1677 microversion: 2.1 time: 0.240873 Jun 16 17:26:36.318963 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 259/526] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:36 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1677 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:36.462734 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-cba343ad-cf07-462a-849b-8ddfeb5e2e68 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:36.463508 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-cba343ad-cf07-462a-849b-8ddfeb5e2e68 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:36.472589 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cba343ad-cf07-462a-849b-8ddfeb5e2e68 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:36.473059 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cba343ad-cf07-462a-849b-8ddfeb5e2e68 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:36.474334 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cba343ad-cf07-462a-849b-8ddfeb5e2e68 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:36.475046 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cba343ad-cf07-462a-849b-8ddfeb5e2e68 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:36.594377 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-cba343ad-cf07-462a-849b-8ddfeb5e2e68 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:36.617934 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-cba343ad-cf07-462a-849b-8ddfeb5e2e68 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1278 microversion: 2.1 time: 0.159123 Jun 16 17:26:36.620461 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 260/527] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:36 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:36.817998 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-2b648513-6591-42f1-8a92-4c6421355fe1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:36.819162 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-2b648513-6591-42f1-8a92-4c6421355fe1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:36.831736 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2b648513-6591-42f1-8a92-4c6421355fe1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:36.832596 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2b648513-6591-42f1-8a92-4c6421355fe1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:36.834332 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2b648513-6591-42f1-8a92-4c6421355fe1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:36.835283 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2b648513-6591-42f1-8a92-4c6421355fe1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:36.909778 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a6219f78-8b09-4e0d-8207-0fc50261defc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:36.942730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a6219f78-8b09-4e0d-8207-0fc50261defc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.726849 Jun 16 17:26:36.945225 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 268/528] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:36 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:37.001574 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7f5d3dea-444e-497a-b5df-99adedaf22ae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:37.006183 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-7f5d3dea-444e-497a-b5df-99adedaf22ae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:37.023211 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7f5d3dea-444e-497a-b5df-99adedaf22ae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:37.024984 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7f5d3dea-444e-497a-b5df-99adedaf22ae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:37.027278 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7f5d3dea-444e-497a-b5df-99adedaf22ae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:37.028209 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7f5d3dea-444e-497a-b5df-99adedaf22ae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:37.050764 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2b648513-6591-42f1-8a92-4c6421355fe1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:37.070033 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-2b648513-6591-42f1-8a92-4c6421355fe1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1266 microversion: 2.1 time: 0.258115 Jun 16 17:26:37.073740 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 261/529] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:36 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:37.343570 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a66339d1-0a08-47b3-9656-fd78ae8a63e8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:37.345884 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a66339d1-0a08-47b3-9656-fd78ae8a63e8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:37.354375 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a66339d1-0a08-47b3-9656-fd78ae8a63e8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:37.354812 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a66339d1-0a08-47b3-9656-fd78ae8a63e8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:37.355845 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a66339d1-0a08-47b3-9656-fd78ae8a63e8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:37.356701 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a66339d1-0a08-47b3-9656-fd78ae8a63e8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:37.513199 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a66339d1-0a08-47b3-9656-fd78ae8a63e8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:37.519005 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7f5d3dea-444e-497a-b5df-99adedaf22ae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:37.523570 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a66339d1-0a08-47b3-9656-fd78ae8a63e8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1677 microversion: 2.1 time: 0.185125 Jun 16 17:26:37.524556 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 262/530] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:37 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:37.530676 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7f5d3dea-444e-497a-b5df-99adedaf22ae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:37.533309 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7f5d3dea-444e-497a-b5df-99adedaf22ae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:37.534767 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7f5d3dea-444e-497a-b5df-99adedaf22ae tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1806 microversion: 2.20 time: 0.561513 Jun 16 17:26:37.535400 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 269/531] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:36 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1806 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:26:37.642939 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-eee0dace-5010-4dde-b28d-ed485d571ef7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:37.643627 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-eee0dace-5010-4dde-b28d-ed485d571ef7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:37.651944 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-eee0dace-5010-4dde-b28d-ed485d571ef7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:37.652543 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-eee0dace-5010-4dde-b28d-ed485d571ef7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:37.653455 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-eee0dace-5010-4dde-b28d-ed485d571ef7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:37.654017 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-eee0dace-5010-4dde-b28d-ed485d571ef7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:37.732292 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-eee0dace-5010-4dde-b28d-ed485d571ef7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:37.741029 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-eee0dace-5010-4dde-b28d-ed485d571ef7 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1276 microversion: 2.1 time: 0.102056 Jun 16 17:26:37.752106 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 263/532] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:37 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1276 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:37.966932 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2f931c85-b128-4571-aa7e-c1a1abc90d2b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:37.967722 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2f931c85-b128-4571-aa7e-c1a1abc90d2b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:37.974826 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2f931c85-b128-4571-aa7e-c1a1abc90d2b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:37.975328 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2f931c85-b128-4571-aa7e-c1a1abc90d2b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:37.976528 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2f931c85-b128-4571-aa7e-c1a1abc90d2b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:37.976957 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2f931c85-b128-4571-aa7e-c1a1abc90d2b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:38.004319 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=100 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:38.090770 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a2895c10-e3ba-4c41-85b6-9cc9ca9fc03a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:38.091524 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a2895c10-e3ba-4c41-85b6-9cc9ca9fc03a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:38.098063 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a2895c10-e3ba-4c41-85b6-9cc9ca9fc03a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:38.098509 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a2895c10-e3ba-4c41-85b6-9cc9ca9fc03a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:38.099282 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a2895c10-e3ba-4c41-85b6-9cc9ca9fc03a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:38.099718 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a2895c10-e3ba-4c41-85b6-9cc9ca9fc03a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:38.273824 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a2895c10-e3ba-4c41-85b6-9cc9ca9fc03a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:38.286837 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2f931c85-b128-4571-aa7e-c1a1abc90d2b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:38.292647 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a2895c10-e3ba-4c41-85b6-9cc9ca9fc03a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1266 microversion: 2.1 time: 0.206369 Jun 16 17:26:38.310632 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2f931c85-b128-4571-aa7e-c1a1abc90d2b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.347607 Jun 16 17:26:38.311145 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 264/533] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:38 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:38.323568 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 270/534] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:37 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:38.328936 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-cf080e43-2a3b-42a4-8e8c-a65a0454ffe0 req-d7b81987-1f22-4f11-a379-f4875b303122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ee9b10-f2da-442c-9475-3cfb21c9ad54", "tag": "676f9af5-715a-4f80-b6f8-747296e84e2c"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:38.340004 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-cf080e43-2a3b-42a4-8e8c-a65a0454ffe0 req-d7b81987-1f22-4f11-a379-f4875b303122 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:38.340927 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-cf080e43-2a3b-42a4-8e8c-a65a0454ffe0 req-d7b81987-1f22-4f11-a379-f4875b303122 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:38.360543 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-cf080e43-2a3b-42a4-8e8c-a65a0454ffe0 req-d7b81987-1f22-4f11-a379-f4875b303122 service nova] Creating event network-changed:676f9af5-715a-4f80-b6f8-747296e84e2c for instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 on hv-cinder-83735 Jun 16 17:26:38.366463 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-cf080e43-2a3b-42a4-8e8c-a65a0454ffe0 req-d7b81987-1f22-4f11-a379-f4875b303122 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053633 Jun 16 17:26:38.367607 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 265/535] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:26:38.543566 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-3b6341a7-188d-4d90-b68d-f6750e736f66 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:38.545613 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-3b6341a7-188d-4d90-b68d-f6750e736f66 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:38.555402 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-cbf29544-1e1d-424b-8bdd-42265c60022f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:38.555865 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3b6341a7-188d-4d90-b68d-f6750e736f66 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:38.556455 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3b6341a7-188d-4d90-b68d-f6750e736f66 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:38.556721 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-cbf29544-1e1d-424b-8bdd-42265c60022f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:38.557705 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3b6341a7-188d-4d90-b68d-f6750e736f66 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:38.558489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3b6341a7-188d-4d90-b68d-f6750e736f66 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:38.564617 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cbf29544-1e1d-424b-8bdd-42265c60022f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:38.566072 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cbf29544-1e1d-424b-8bdd-42265c60022f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:38.567036 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cbf29544-1e1d-424b-8bdd-42265c60022f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:38.567465 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-cbf29544-1e1d-424b-8bdd-42265c60022f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:38.756039 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-cbf29544-1e1d-424b-8bdd-42265c60022f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:38.766971 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-cbf29544-1e1d-424b-8bdd-42265c60022f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:38.768337 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-cbf29544-1e1d-424b-8bdd-42265c60022f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:38.769585 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-cbf29544-1e1d-424b-8bdd-42265c60022f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1793 microversion: 2.20 time: 0.218789 Jun 16 17:26:38.770138 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 266/536] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:26:38 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1793 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:26:38.777650 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0ce2b6ed-2805-4137-adbc-97cb5a8f38ed tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:38.778346 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0ce2b6ed-2805-4137-adbc-97cb5a8f38ed tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:38.794826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0ce2b6ed-2805-4137-adbc-97cb5a8f38ed tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:38.796387 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0ce2b6ed-2805-4137-adbc-97cb5a8f38ed tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:38.798207 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0ce2b6ed-2805-4137-adbc-97cb5a8f38ed tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:38.798650 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0ce2b6ed-2805-4137-adbc-97cb5a8f38ed tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:38.815702 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-3b6341a7-188d-4d90-b68d-f6750e736f66 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:38.834375 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-3b6341a7-188d-4d90-b68d-f6750e736f66 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1677 microversion: 2.1 time: 0.291920 Jun 16 17:26:38.839213 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 271/537] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:38 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1677 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:39.136517 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0ce2b6ed-2805-4137-adbc-97cb5a8f38ed tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:39.166356 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0ce2b6ed-2805-4137-adbc-97cb5a8f38ed tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1318 microversion: 2.1 time: 0.392462 Jun 16 17:26:39.168304 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 267/538] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:38 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:39.323198 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5a2a6e99-9875-4522-80eb-870054683bab tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:39.324327 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5a2a6e99-9875-4522-80eb-870054683bab tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:39.340797 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5a2a6e99-9875-4522-80eb-870054683bab tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:39.341009 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b76bb4db-a64c-4855-8520-16ca5fb61527 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:39.344159 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5a2a6e99-9875-4522-80eb-870054683bab tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:39.345275 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5a2a6e99-9875-4522-80eb-870054683bab tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:39.345941 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5a2a6e99-9875-4522-80eb-870054683bab tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:39.346234 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b76bb4db-a64c-4855-8520-16ca5fb61527 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:39.370525 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b76bb4db-a64c-4855-8520-16ca5fb61527 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:39.371300 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b76bb4db-a64c-4855-8520-16ca5fb61527 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:39.376677 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b76bb4db-a64c-4855-8520-16ca5fb61527 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:39.378157 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b76bb4db-a64c-4855-8520-16ca5fb61527 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:39.753511 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-5a2a6e99-9875-4522-80eb-870054683bab tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:39.763750 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5a2a6e99-9875-4522-80eb-870054683bab tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1454 microversion: 2.1 time: 0.451213 Jun 16 17:26:39.764983 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 272/539] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:39 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1454 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:39.802638 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-700d0ac3-d72e-441b-8948-bc054839bcde tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:39.810542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-700d0ac3-d72e-441b-8948-bc054839bcde tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:39.821338 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-700d0ac3-d72e-441b-8948-bc054839bcde tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:39.821731 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-700d0ac3-d72e-441b-8948-bc054839bcde tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:39.822528 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-700d0ac3-d72e-441b-8948-bc054839bcde tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:39.822955 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-700d0ac3-d72e-441b-8948-bc054839bcde tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:40.050278 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-b76bb4db-a64c-4855-8520-16ca5fb61527 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:40.060270 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b76bb4db-a64c-4855-8520-16ca5fb61527 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.732206 Jun 16 17:26:40.064686 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 268/540] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:39 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:40.070748 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d3a11830-d686-4fd5-a613-3dc2b3632e1b tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:40.072835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d3a11830-d686-4fd5-a613-3dc2b3632e1b tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:40.081525 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d3a11830-d686-4fd5-a613-3dc2b3632e1b tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:40.083320 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d3a11830-d686-4fd5-a613-3dc2b3632e1b tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:40.084587 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d3a11830-d686-4fd5-a613-3dc2b3632e1b tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:40.085424 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d3a11830-d686-4fd5-a613-3dc2b3632e1b tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:40.147656 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-700d0ac3-d72e-441b-8948-bc054839bcde tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:40.158209 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-700d0ac3-d72e-441b-8948-bc054839bcde tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1454 microversion: 2.1 time: 0.377138 Jun 16 17:26:40.158209 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 273/541] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:39 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1454 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:40.194161 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-437bde06-4e12-4661-9449-a0ff4554ea87 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:40.195310 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-437bde06-4e12-4661-9449-a0ff4554ea87 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:40.213345 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-437bde06-4e12-4661-9449-a0ff4554ea87 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:40.214658 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-437bde06-4e12-4661-9449-a0ff4554ea87 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:40.215806 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-437bde06-4e12-4661-9449-a0ff4554ea87 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:40.216452 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-437bde06-4e12-4661-9449-a0ff4554ea87 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:40.313565 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d3a11830-d686-4fd5-a613-3dc2b3632e1b tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:40.329195 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d3a11830-d686-4fd5-a613-3dc2b3632e1b tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1654 microversion: 2.1 time: 0.257761 Jun 16 17:26:40.330712 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 269/542] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:40 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1654 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:40.349428 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-03a4346b-5e63-40da-b74d-c1e6b13ea051 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:40.357918 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-03a4346b-5e63-40da-b74d-c1e6b13ea051 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:40.358367 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-03a4346b-5e63-40da-b74d-c1e6b13ea051 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:40.386504 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-03a4346b-5e63-40da-b74d-c1e6b13ea051 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Going to try to start instance {{(pid=117552) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 17:26:40.444405 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-03a4346b-5e63-40da-b74d-c1e6b13ea051 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "POST /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/action" status: 202 len: 0 microversion: 2.1 time: 0.099153 Jun 16 17:26:40.449441 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 270/543] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jun 16 17:26:40 2022] POST /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:26:40.459121 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-784ce9d9-9165-464f-9ae9-fe7c6bd356c9 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:40.459881 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-784ce9d9-9165-464f-9ae9-fe7c6bd356c9 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:40.468455 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-784ce9d9-9165-464f-9ae9-fe7c6bd356c9 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:40.468912 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-784ce9d9-9165-464f-9ae9-fe7c6bd356c9 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:40.474414 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-784ce9d9-9165-464f-9ae9-fe7c6bd356c9 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:40.476175 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-784ce9d9-9165-464f-9ae9-fe7c6bd356c9 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:40.632013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-784ce9d9-9165-464f-9ae9-fe7c6bd356c9 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:40.640842 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-784ce9d9-9165-464f-9ae9-fe7c6bd356c9 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1663 microversion: 2.1 time: 0.189484 Jun 16 17:26:40.642000 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 271/544] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:40 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1663 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:40.647418 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-74cf286a-488b-410e-86a8-970891b10c62 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1613302764"}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:40.648341 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-74cf286a-488b-410e-86a8-970891b10c62 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:40.656756 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-74cf286a-488b-410e-86a8-970891b10c62 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:40.657610 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-74cf286a-488b-410e-86a8-970891b10c62 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:40.658976 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-74cf286a-488b-410e-86a8-970891b10c62 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:40.659547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-74cf286a-488b-410e-86a8-970891b10c62 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:40.700604 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-437bde06-4e12-4661-9449-a0ff4554ea87 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:40.710492 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-437bde06-4e12-4661-9449-a0ff4554ea87 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1318 microversion: 2.1 time: 0.522503 Jun 16 17:26:40.724058 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 274/545] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:40 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1318 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:40.731947 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-0089fbc1-05b5-43c5-86e6-f4c8c05e36f7 req-ef808105-b0e4-4eda-96a9-17aa4c1b6b3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1394894f-f188-4863-8a8e-19e8498a38c0", "tag": "2e065346-bbf2-4d07-9223-ade0165e1288"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:40.745943 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-0089fbc1-05b5-43c5-86e6-f4c8c05e36f7 req-ef808105-b0e4-4eda-96a9-17aa4c1b6b3f service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:40.747119 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-0089fbc1-05b5-43c5-86e6-f4c8c05e36f7 req-ef808105-b0e4-4eda-96a9-17aa4c1b6b3f service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:40.774242 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-0089fbc1-05b5-43c5-86e6-f4c8c05e36f7 req-ef808105-b0e4-4eda-96a9-17aa4c1b6b3f service nova] Creating event network-changed:2e065346-bbf2-4d07-9223-ade0165e1288 for instance 1394894f-f188-4863-8a8e-19e8498a38c0 on hv-cinder-83735 Jun 16 17:26:40.786487 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-0089fbc1-05b5-43c5-86e6-f4c8c05e36f7 req-ef808105-b0e4-4eda-96a9-17aa4c1b6b3f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059458 Jun 16 17:26:40.788890 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 275/546] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:26:41.033149 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.network.security_group_api [None req-74cf286a-488b-410e-86a8-970891b10c62 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Adding security group 66f70e9b-7bf4-4a7a-a0da-bf4af5a755fa to port 676f9af5-715a-4f80-b6f8-747296e84e2c Jun 16 17:26:41.094708 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7835de2b-320e-44e1-a67b-74887f96bc9b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:41.096130 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-7835de2b-320e-44e1-a67b-74887f96bc9b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:41.108997 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7835de2b-320e-44e1-a67b-74887f96bc9b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:41.110199 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7835de2b-320e-44e1-a67b-74887f96bc9b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:41.111659 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7835de2b-320e-44e1-a67b-74887f96bc9b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:41.112817 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7835de2b-320e-44e1-a67b-74887f96bc9b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:41.439819 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7835de2b-320e-44e1-a67b-74887f96bc9b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:41.453556 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7835de2b-320e-44e1-a67b-74887f96bc9b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.367548 Jun 16 17:26:41.454753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 276/547] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:41 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:41.662565 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b6d6b9df-d5f5-4d82-914d-f8beef716978 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:41.664039 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-b6d6b9df-d5f5-4d82-914d-f8beef716978 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:41.673938 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b6d6b9df-d5f5-4d82-914d-f8beef716978 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:41.674402 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b6d6b9df-d5f5-4d82-914d-f8beef716978 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:41.675209 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b6d6b9df-d5f5-4d82-914d-f8beef716978 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:41.675637 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b6d6b9df-d5f5-4d82-914d-f8beef716978 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:41.959526 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-74cf286a-488b-410e-86a8-970891b10c62 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "POST /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54/action" status: 202 len: 0 microversion: 2.1 time: 1.316412 Jun 16 17:26:41.961361 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 272/548] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jun 16 17:26:40 2022] POST /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54/action => generated 0 bytes in 1319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:26:41.969238 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-2ba7580e-185d-40c4-8d9b-007c8639833b tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:41.980521 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-2ba7580e-185d-40c4-8d9b-007c8639833b tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:42.014001 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2ba7580e-185d-40c4-8d9b-007c8639833b tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:42.015071 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2ba7580e-185d-40c4-8d9b-007c8639833b tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:42.016740 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2ba7580e-185d-40c4-8d9b-007c8639833b tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:42.019348 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2ba7580e-185d-40c4-8d9b-007c8639833b tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:42.070417 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:42.076962 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b6d6b9df-d5f5-4d82-914d-f8beef716978 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:42.123007 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b6d6b9df-d5f5-4d82-914d-f8beef716978 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1663 microversion: 2.1 time: 0.465592 Jun 16 17:26:42.130134 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 277/549] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:41 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1663 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:42.144817 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-52d8e638-fdc7-4534-83cc-98b884c9a30f req-e6ed3175-f5b7-40b7-9c31-ac4eafaf0786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ee9b10-f2da-442c-9475-3cfb21c9ad54", "tag": "676f9af5-715a-4f80-b6f8-747296e84e2c"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:42.167023 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-52d8e638-fdc7-4534-83cc-98b884c9a30f req-e6ed3175-f5b7-40b7-9c31-ac4eafaf0786 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:42.168097 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-52d8e638-fdc7-4534-83cc-98b884c9a30f req-e6ed3175-f5b7-40b7-9c31-ac4eafaf0786 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:42.209515 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-52d8e638-fdc7-4534-83cc-98b884c9a30f req-e6ed3175-f5b7-40b7-9c31-ac4eafaf0786 service nova] Creating event network-changed:676f9af5-715a-4f80-b6f8-747296e84e2c for instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 on hv-cinder-83735 Jun 16 17:26:42.227125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-52d8e638-fdc7-4534-83cc-98b884c9a30f req-e6ed3175-f5b7-40b7-9c31-ac4eafaf0786 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095550 Jun 16 17:26:42.227747 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 278/550] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:26:42.237413 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-3f104520-30da-4895-84d3-d00cd26606c7 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:42.238677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-3f104520-30da-4895-84d3-d00cd26606c7 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:42.273994 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3f104520-30da-4895-84d3-d00cd26606c7 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:42.274440 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3f104520-30da-4895-84d3-d00cd26606c7 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:42.279230 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3f104520-30da-4895-84d3-d00cd26606c7 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:42.281548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3f104520-30da-4895-84d3-d00cd26606c7 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:42.453266 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2ba7580e-185d-40c4-8d9b-007c8639833b tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:42.463409 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-2ba7580e-185d-40c4-8d9b-007c8639833b tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1318 microversion: 2.1 time: 0.500516 Jun 16 17:26:42.473339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 273/551] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:41 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:42.479766 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-531a1abf-2219-463a-8d03-545cd912bf69 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:42.480615 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-531a1abf-2219-463a-8d03-545cd912bf69 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:42.488995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-531a1abf-2219-463a-8d03-545cd912bf69 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:42.489839 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-531a1abf-2219-463a-8d03-545cd912bf69 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:42.490846 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-531a1abf-2219-463a-8d03-545cd912bf69 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:42.491634 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-531a1abf-2219-463a-8d03-545cd912bf69 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:42.580972 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-3f104520-30da-4895-84d3-d00cd26606c7 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:42.590107 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-3f104520-30da-4895-84d3-d00cd26606c7 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1642 microversion: 2.1 time: 0.357425 Jun 16 17:26:42.590967 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 279/552] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:42 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1642 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:42.691408 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-531a1abf-2219-463a-8d03-545cd912bf69 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:42.702838 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-531a1abf-2219-463a-8d03-545cd912bf69 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1734 microversion: 2.1 time: 0.227150 Jun 16 17:26:42.703807 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 274/553] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:42 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1734 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:43.156641 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-111fb422-1185-45ea-b44d-fd9ece4a70e7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:43.157769 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-111fb422-1185-45ea-b44d-fd9ece4a70e7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:43.166544 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-111fb422-1185-45ea-b44d-fd9ece4a70e7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:43.167282 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-111fb422-1185-45ea-b44d-fd9ece4a70e7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:43.168193 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-111fb422-1185-45ea-b44d-fd9ece4a70e7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:43.168728 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-111fb422-1185-45ea-b44d-fd9ece4a70e7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:43.432942 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-111fb422-1185-45ea-b44d-fd9ece4a70e7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:43.442585 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-111fb422-1185-45ea-b44d-fd9ece4a70e7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1663 microversion: 2.1 time: 0.292648 Jun 16 17:26:43.453996 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 280/554] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:43 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1663 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:43.482595 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-63515040-1f86-49a4-b5f7-e3eb0ee9e06d tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:43.484629 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-63515040-1f86-49a4-b5f7-e3eb0ee9e06d tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:43.501989 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-63515040-1f86-49a4-b5f7-e3eb0ee9e06d tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:43.502444 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-63515040-1f86-49a4-b5f7-e3eb0ee9e06d tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:43.503233 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-63515040-1f86-49a4-b5f7-e3eb0ee9e06d tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:43.504127 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-63515040-1f86-49a4-b5f7-e3eb0ee9e06d tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:43.535009 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-74901b9d-2566-4b7d-8d60-9779802f5869 req-a7e0e591-fa2e-4753-9d4f-6b0d5769eef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157a0c77-c88e-4ef0-aef5-6ba851b57d00", "tag": "0fdde9ef-e61f-4c66-9976-8477640c42a6"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:43.552143 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-74901b9d-2566-4b7d-8d60-9779802f5869 req-a7e0e591-fa2e-4753-9d4f-6b0d5769eef2 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:43.553465 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-74901b9d-2566-4b7d-8d60-9779802f5869 req-a7e0e591-fa2e-4753-9d4f-6b0d5769eef2 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:43.575224 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-74901b9d-2566-4b7d-8d60-9779802f5869 req-a7e0e591-fa2e-4753-9d4f-6b0d5769eef2 service nova] Creating event network-changed:0fdde9ef-e61f-4c66-9976-8477640c42a6 for instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 on hv-cinder-83735 Jun 16 17:26:43.583004 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-74901b9d-2566-4b7d-8d60-9779802f5869 req-a7e0e591-fa2e-4753-9d4f-6b0d5769eef2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055482 Jun 16 17:26:43.584163 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 281/555] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:26:43.687008 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-63515040-1f86-49a4-b5f7-e3eb0ee9e06d tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:43.696288 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-63515040-1f86-49a4-b5f7-e3eb0ee9e06d tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1318 microversion: 2.1 time: 0.219274 Jun 16 17:26:43.696875 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 275/556] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:43 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:43.729564 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-aea9ceb4-8233-442b-b5d9-8c0e4dd1fdad tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:43.730266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-aea9ceb4-8233-442b-b5d9-8c0e4dd1fdad tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:43.738247 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-aea9ceb4-8233-442b-b5d9-8c0e4dd1fdad tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:43.738931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-aea9ceb4-8233-442b-b5d9-8c0e4dd1fdad tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:43.739330 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-aea9ceb4-8233-442b-b5d9-8c0e4dd1fdad tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:43.739739 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-aea9ceb4-8233-442b-b5d9-8c0e4dd1fdad tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:43.913458 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-aea9ceb4-8233-442b-b5d9-8c0e4dd1fdad tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:43.923019 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-aea9ceb4-8233-442b-b5d9-8c0e4dd1fdad tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1714 microversion: 2.1 time: 0.198066 Jun 16 17:26:43.923932 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 282/557] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:43 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1714 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:44.160921 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0bedcf9d-912e-4f40-8b9a-84435b2e41dc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:44.161656 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0bedcf9d-912e-4f40-8b9a-84435b2e41dc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:44.169213 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0bedcf9d-912e-4f40-8b9a-84435b2e41dc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:44.170267 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0bedcf9d-912e-4f40-8b9a-84435b2e41dc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:44.171729 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0bedcf9d-912e-4f40-8b9a-84435b2e41dc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:44.172490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0bedcf9d-912e-4f40-8b9a-84435b2e41dc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:44.285064 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-0bedcf9d-912e-4f40-8b9a-84435b2e41dc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] HTTP exception thrown: Cannot 'detach_volume' instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b while it is in vm_state rescued Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0bedcf9d-912e-4f40-8b9a-84435b2e41dc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Request method failure captured: Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: DELETE /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/os-volume_attachments/c56cbab9-9648-4d55-8c9a-e973c96b8ea4 HTTP/1.1 Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2baiTAiiIqvs05AAgXEGNrzgTOS0KD51O8IrwALK_82kaIh4oIhGWJGUbDxg3s9UADdVPKzO_ZDdu65W2o4SzEeVM38vngvZj4zT9_ojpKoesbQIclVOSFNU9SjyczrwaH1BGy99G4f7f3jUdIV6_zsnlingiczP1owxkwlv_alFaA Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: ccf5c45783454fc5a7872490196f07e0 Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1475515620 Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:26:44.287446 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:26:44.289260 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ccf5c45783454fc5a7872490196f07e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ccf5c45783454fc5a7872490196f07e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ccf5c45783454fc5a7872490196f07e0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ccf5c45783454fc5a7872490196f07e0"}]}] Jun 16 17:26:44.289260 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1475515620 Jun 16 17:26:44.289260 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: ccf5c45783454fc5a7872490196f07e0 Jun 16 17:26:44.289260 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1475515620 Jun 16 17:26:44.289260 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-ServerRescueNegativeTestJSON-1475515620-project Jun 16 17:26:44.289260 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:26:44.289260 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:26:44.289260 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 0cd8a309f6914d83b8e72bc60a5d7924 Jun 16 17:26:44.289260 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1475515620-project Jun 16 17:26:44.289260 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:26:44.289260 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Cannot 'detach_volume' instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b while it is in vm_state rescued Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'server_id': '4065d5c1-0b16-413a-a5b5-e0e725e1e71b', 'id': 'c56cbab9-9648-4d55-8c9a-e973c96b8ea4'} Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:26:44.290082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:26:44.291396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 17:26:44.291396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 17:26:44.291396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 17:26:44.291396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 17:26:44.291396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b while it is in vm_state rescued Jun 16 17:26:44.291396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:26:44.291396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:26:44.291396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:26:44.291396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:26:44.291396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:26:44.291396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:26:44.291396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:26:44.291396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:26:44.291396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b while it is in vm_state rescued Jun 16 17:26:44.291396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:26:44.295070 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0bedcf9d-912e-4f40-8b9a-84435b2e41dc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Returning 409 to user: Cannot 'detach_volume' instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b while it is in vm_state rescued {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:26:44.296278 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0bedcf9d-912e-4f40-8b9a-84435b2e41dc tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/os-volume_attachments/c56cbab9-9648-4d55-8c9a-e973c96b8ea4" status: 409 len: 152 microversion: 2.1 time: 0.144378 Jun 16 17:26:44.297092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 276/558] 10.222.0.66 () {58 vars in 1415 bytes} [Thu Jun 16 17:26:44 2022] DELETE /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/os-volume_attachments/c56cbab9-9648-4d55-8c9a-e973c96b8ea4 => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 17:26:44.306781 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-845d4269-f6e4-48ce-a94d-a2183f54e118 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:44.308490 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-845d4269-f6e4-48ce-a94d-a2183f54e118 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:44.313012 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:44.314826 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=6 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:44.321742 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-845d4269-f6e4-48ce-a94d-a2183f54e118 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:44.322554 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-845d4269-f6e4-48ce-a94d-a2183f54e118 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:44.323565 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-845d4269-f6e4-48ce-a94d-a2183f54e118 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:44.324164 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-845d4269-f6e4-48ce-a94d-a2183f54e118 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:44.411590 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-845d4269-f6e4-48ce-a94d-a2183f54e118 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "POST /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/action" status: 202 len: 0 microversion: 2.1 time: 0.109484 Jun 16 17:26:44.413158 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 283/559] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jun 16 17:26:44 2022] POST /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:26:44.423460 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-98bb1cfa-a87a-47d5-ac4a-bf3c7dfd244f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:44.425053 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-98bb1cfa-a87a-47d5-ac4a-bf3c7dfd244f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:44.428439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:44.436279 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-98bb1cfa-a87a-47d5-ac4a-bf3c7dfd244f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:44.437293 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-98bb1cfa-a87a-47d5-ac4a-bf3c7dfd244f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:44.438247 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-98bb1cfa-a87a-47d5-ac4a-bf3c7dfd244f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:44.438842 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-98bb1cfa-a87a-47d5-ac4a-bf3c7dfd244f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:44.461890 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b401a487-7aae-40dc-83f4-6de5bd1c96bc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:44.463299 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-b401a487-7aae-40dc-83f4-6de5bd1c96bc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:44.476232 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b401a487-7aae-40dc-83f4-6de5bd1c96bc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:44.477694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b401a487-7aae-40dc-83f4-6de5bd1c96bc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:44.479501 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b401a487-7aae-40dc-83f4-6de5bd1c96bc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:44.483467 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b401a487-7aae-40dc-83f4-6de5bd1c96bc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:44.818537 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-98bb1cfa-a87a-47d5-ac4a-bf3c7dfd244f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:44.829595 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-98bb1cfa-a87a-47d5-ac4a-bf3c7dfd244f tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1722 microversion: 2.1 time: 0.411060 Jun 16 17:26:44.830888 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 277/560] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:44 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1722 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:44.837227 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-09d7416c-b450-4361-b56c-05e813b97b89 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:44.838280 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-09d7416c-b450-4361-b56c-05e813b97b89 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:44.846850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-09d7416c-b450-4361-b56c-05e813b97b89 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:44.847746 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-09d7416c-b450-4361-b56c-05e813b97b89 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:44.849036 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-09d7416c-b450-4361-b56c-05e813b97b89 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:44.849772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-09d7416c-b450-4361-b56c-05e813b97b89 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:44.894787 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b401a487-7aae-40dc-83f4-6de5bd1c96bc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:44.911773 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b401a487-7aae-40dc-83f4-6de5bd1c96bc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1663 microversion: 2.1 time: 0.454196 Jun 16 17:26:44.914844 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 284/561] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:44 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1663 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:45.194072 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-09d7416c-b450-4361-b56c-05e813b97b89 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:45.202899 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-09d7416c-b450-4361-b56c-05e813b97b89 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1318 microversion: 2.1 time: 0.370656 Jun 16 17:26:45.203881 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 278/562] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:44 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:45.847919 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-de6d1591-176d-47a6-8d70-b65d44bae988 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:45.848498 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-de6d1591-176d-47a6-8d70-b65d44bae988 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:45.855503 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-de6d1591-176d-47a6-8d70-b65d44bae988 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:45.855943 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-de6d1591-176d-47a6-8d70-b65d44bae988 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:45.856768 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-de6d1591-176d-47a6-8d70-b65d44bae988 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:45.857147 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-de6d1591-176d-47a6-8d70-b65d44bae988 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:45.932859 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5ae93f38-71e5-4973-bbde-a6f7a22007e5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:45.934201 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-5ae93f38-71e5-4973-bbde-a6f7a22007e5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:45.942443 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5ae93f38-71e5-4973-bbde-a6f7a22007e5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:45.942443 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5ae93f38-71e5-4973-bbde-a6f7a22007e5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:45.942861 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5ae93f38-71e5-4973-bbde-a6f7a22007e5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:45.943257 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5ae93f38-71e5-4973-bbde-a6f7a22007e5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:45.999310 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-de6d1591-176d-47a6-8d70-b65d44bae988 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:46.018165 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-de6d1591-176d-47a6-8d70-b65d44bae988 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1722 microversion: 2.1 time: 0.174138 Jun 16 17:26:46.018804 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 285/563] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:45 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:46.228018 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-fd31643b-ab39-4e04-8da1-f2c852cc68c6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:46.230134 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-fd31643b-ab39-4e04-8da1-f2c852cc68c6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:46.240507 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5ae93f38-71e5-4973-bbde-a6f7a22007e5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:46.246635 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fd31643b-ab39-4e04-8da1-f2c852cc68c6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:46.247306 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fd31643b-ab39-4e04-8da1-f2c852cc68c6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:46.248301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fd31643b-ab39-4e04-8da1-f2c852cc68c6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:46.248897 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fd31643b-ab39-4e04-8da1-f2c852cc68c6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:46.252379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-5ae93f38-71e5-4973-bbde-a6f7a22007e5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1667 microversion: 2.1 time: 0.323866 Jun 16 17:26:46.268102 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 279/564] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:45 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1667 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:46.273677 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-62f01cfb-f3fd-4097-ac2c-a0b3a1f8af63 req-19df3cc6-dd01-4915-80cc-e4bb9a05e5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1394894f-f188-4863-8a8e-19e8498a38c0", "name": "network-vif-plugged", "status": "completed", "tag": "2e065346-bbf2-4d07-9223-ade0165e1288"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:46.284304 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-62f01cfb-f3fd-4097-ac2c-a0b3a1f8af63 req-19df3cc6-dd01-4915-80cc-e4bb9a05e5f9 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:46.285003 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-62f01cfb-f3fd-4097-ac2c-a0b3a1f8af63 req-19df3cc6-dd01-4915-80cc-e4bb9a05e5f9 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:46.306073 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-62f01cfb-f3fd-4097-ac2c-a0b3a1f8af63 req-19df3cc6-dd01-4915-80cc-e4bb9a05e5f9 service nova] Creating event network-vif-plugged:2e065346-bbf2-4d07-9223-ade0165e1288 for instance 1394894f-f188-4863-8a8e-19e8498a38c0 on hv-cinder-83735 Jun 16 17:26:46.313937 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-62f01cfb-f3fd-4097-ac2c-a0b3a1f8af63 req-19df3cc6-dd01-4915-80cc-e4bb9a05e5f9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044221 Jun 16 17:26:46.314857 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 280/565] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:26:46.503009 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-fd31643b-ab39-4e04-8da1-f2c852cc68c6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:46.512920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-fd31643b-ab39-4e04-8da1-f2c852cc68c6 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1318 microversion: 2.1 time: 0.294822 Jun 16 17:26:46.513521 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 286/566] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:46 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:47.040797 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7f5a5b10-2242-40f4-876a-97c79ce3f6c8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:47.041393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7f5a5b10-2242-40f4-876a-97c79ce3f6c8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:47.048871 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7f5a5b10-2242-40f4-876a-97c79ce3f6c8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:47.049348 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7f5a5b10-2242-40f4-876a-97c79ce3f6c8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:47.050124 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7f5a5b10-2242-40f4-876a-97c79ce3f6c8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:47.050553 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7f5a5b10-2242-40f4-876a-97c79ce3f6c8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:47.481585 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7f5a5b10-2242-40f4-876a-97c79ce3f6c8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:47.491892 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7f5a5b10-2242-40f4-876a-97c79ce3f6c8 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1722 microversion: 2.1 time: 0.455868 Jun 16 17:26:47.492742 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 281/567] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:47 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1722 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:47.530951 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-be89ca2e-57b2-45ee-9f91-3db8da78072c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:47.531538 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-be89ca2e-57b2-45ee-9f91-3db8da78072c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:47.538891 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-be89ca2e-57b2-45ee-9f91-3db8da78072c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:47.539332 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-be89ca2e-57b2-45ee-9f91-3db8da78072c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:47.540101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-be89ca2e-57b2-45ee-9f91-3db8da78072c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:47.540526 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-be89ca2e-57b2-45ee-9f91-3db8da78072c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:47.708989 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-be89ca2e-57b2-45ee-9f91-3db8da78072c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:47.720026 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-be89ca2e-57b2-45ee-9f91-3db8da78072c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1318 microversion: 2.1 time: 0.192285 Jun 16 17:26:47.720570 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 287/568] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:47 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:48.512127 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-71baef7b-4f4e-4cb3-bbe2-dee64a3017f4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:48.513086 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-71baef7b-4f4e-4cb3-bbe2-dee64a3017f4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:48.520701 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-71baef7b-4f4e-4cb3-bbe2-dee64a3017f4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:48.521246 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-71baef7b-4f4e-4cb3-bbe2-dee64a3017f4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:48.522210 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-71baef7b-4f4e-4cb3-bbe2-dee64a3017f4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:48.523315 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-71baef7b-4f4e-4cb3-bbe2-dee64a3017f4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:48.666553 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-71baef7b-4f4e-4cb3-bbe2-dee64a3017f4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:48.675296 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-71baef7b-4f4e-4cb3-bbe2-dee64a3017f4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1722 microversion: 2.1 time: 0.168491 Jun 16 17:26:48.675914 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 282/569] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:48 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:48.740909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-60418d4f-e38f-45af-b825-dea4245a7a0a tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:48.741580 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-60418d4f-e38f-45af-b825-dea4245a7a0a tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:48.750805 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-60418d4f-e38f-45af-b825-dea4245a7a0a tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:48.751369 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-60418d4f-e38f-45af-b825-dea4245a7a0a tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:48.752537 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-60418d4f-e38f-45af-b825-dea4245a7a0a tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:48.753063 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-60418d4f-e38f-45af-b825-dea4245a7a0a tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:48.756882 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:48.897831 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-60418d4f-e38f-45af-b825-dea4245a7a0a tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:48.906782 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-60418d4f-e38f-45af-b825-dea4245a7a0a tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1318 microversion: 2.1 time: 0.170791 Jun 16 17:26:48.907674 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 288/570] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:48 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:49.694651 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e436c499-2dd0-49e9-8b3b-768b9133fbf1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:49.695276 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e436c499-2dd0-49e9-8b3b-768b9133fbf1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:49.702100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e436c499-2dd0-49e9-8b3b-768b9133fbf1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:49.702546 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e436c499-2dd0-49e9-8b3b-768b9133fbf1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:49.703316 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e436c499-2dd0-49e9-8b3b-768b9133fbf1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:49.703737 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e436c499-2dd0-49e9-8b3b-768b9133fbf1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:49.846378 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-e436c499-2dd0-49e9-8b3b-768b9133fbf1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:49.858358 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-e436c499-2dd0-49e9-8b3b-768b9133fbf1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1728 microversion: 2.1 time: 0.167852 Jun 16 17:26:49.858977 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 283/571] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:49 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:49.877526 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f24eeb33-f687-4b70-be4e-ae925bb896f1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:49.878063 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f24eeb33-f687-4b70-be4e-ae925bb896f1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:49.885203 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f24eeb33-f687-4b70-be4e-ae925bb896f1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:49.885645 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f24eeb33-f687-4b70-be4e-ae925bb896f1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:49.886396 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f24eeb33-f687-4b70-be4e-ae925bb896f1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:49.886877 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f24eeb33-f687-4b70-be4e-ae925bb896f1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:49.925667 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-1ad8949a-1ce4-490b-ac4b-f32ca2a4fbae tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:49.926368 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-1ad8949a-1ce4-490b-ac4b-f32ca2a4fbae tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:49.933925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1ad8949a-1ce4-490b-ac4b-f32ca2a4fbae tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:49.934365 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1ad8949a-1ce4-490b-ac4b-f32ca2a4fbae tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:49.935144 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1ad8949a-1ce4-490b-ac4b-f32ca2a4fbae tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:49.935672 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1ad8949a-1ce4-490b-ac4b-f32ca2a4fbae tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:49.980399 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f24eeb33-f687-4b70-be4e-ae925bb896f1 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106830 Jun 16 17:26:49.980959 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 289/572] 10.222.0.66 () {58 vars in 1274 bytes} [Thu Jun 16 17:26:49 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:26:50.095722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-1ad8949a-1ce4-490b-ac4b-f32ca2a4fbae tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:50.105568 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-1ad8949a-1ce4-490b-ac4b-f32ca2a4fbae tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1318 microversion: 2.1 time: 0.183264 Jun 16 17:26:50.107973 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 284/573] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:49 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:26:50.965879 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-7ba1efd3-5fe6-426f-9e35-03a1fa5ecf10 req-ea8f7b03-9a57-4c9e-96c2-b4955ca0e341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4065d5c1-0b16-413a-a5b5-e0e725e1e71b", "tag": "3e68f997-7180-47a9-a1f0-ae3a5f70d0a3"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:50.974990 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-7ba1efd3-5fe6-426f-9e35-03a1fa5ecf10 req-ea8f7b03-9a57-4c9e-96c2-b4955ca0e341 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:50.976300 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-7ba1efd3-5fe6-426f-9e35-03a1fa5ecf10 req-ea8f7b03-9a57-4c9e-96c2-b4955ca0e341 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:50.988564 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-7ba1efd3-5fe6-426f-9e35-03a1fa5ecf10 req-ea8f7b03-9a57-4c9e-96c2-b4955ca0e341 service nova] Creating event network-changed:3e68f997-7180-47a9-a1f0-ae3a5f70d0a3 for instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b on hv-cinder-83735 Jun 16 17:26:50.997869 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-7ba1efd3-5fe6-426f-9e35-03a1fa5ecf10 req-ea8f7b03-9a57-4c9e-96c2-b4955ca0e341 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036407 Jun 16 17:26:50.998665 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 290/574] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:26:51.126045 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-2c7a8762-c737-44b9-bf76-4bd02c329797 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:51.127674 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-2c7a8762-c737-44b9-bf76-4bd02c329797 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:51.135344 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2c7a8762-c737-44b9-bf76-4bd02c329797 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:51.135879 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2c7a8762-c737-44b9-bf76-4bd02c329797 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:51.136706 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2c7a8762-c737-44b9-bf76-4bd02c329797 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:51.137690 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2c7a8762-c737-44b9-bf76-4bd02c329797 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:51.361852 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2c7a8762-c737-44b9-bf76-4bd02c329797 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:26:51.370718 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-2c7a8762-c737-44b9-bf76-4bd02c329797 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1508 microversion: 2.1 time: 0.248770 Jun 16 17:26:51.371672 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 285/575] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:26:51 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1508 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:26:51.389060 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-50247a56-d174-4fa8-8e09-99a8be1505ef tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4cecb90-ef78-466c-b291-209949913f3d", "device": "/dev/sdb"}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:51.391383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-50247a56-d174-4fa8-8e09-99a8be1505ef tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:26:51.398517 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-50247a56-d174-4fa8-8e09-99a8be1505ef tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:51.399164 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-50247a56-d174-4fa8-8e09-99a8be1505ef tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:51.399946 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-50247a56-d174-4fa8-8e09-99a8be1505ef tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:51.400520 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-50247a56-d174-4fa8-8e09-99a8be1505ef tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:51.702944 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-50247a56-d174-4fa8-8e09-99a8be1505ef tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "POST /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318382 Jun 16 17:26:51.704930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 291/576] 10.222.0.66 () {60 vars in 1322 bytes} [Thu Jun 16 17:26:51 2022] POST /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:26:53.017225 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-2793d47e-9809-40c5-b0b8-d7cd63974df0 req-04dcdeb3-3cb9-4f2b-8e36-c3b3daaa22bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4065d5c1-0b16-413a-a5b5-e0e725e1e71b", "tag": "3e68f997-7180-47a9-a1f0-ae3a5f70d0a3"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:26:53.027797 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-2793d47e-9809-40c5-b0b8-d7cd63974df0 req-04dcdeb3-3cb9-4f2b-8e36-c3b3daaa22bf service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:26:53.028234 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-2793d47e-9809-40c5-b0b8-d7cd63974df0 req-04dcdeb3-3cb9-4f2b-8e36-c3b3daaa22bf service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:26:53.041372 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-2793d47e-9809-40c5-b0b8-d7cd63974df0 req-04dcdeb3-3cb9-4f2b-8e36-c3b3daaa22bf service nova] Creating event network-changed:3e68f997-7180-47a9-a1f0-ae3a5f70d0a3 for instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b on hv-cinder-83735 Jun 16 17:26:53.047969 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-2793d47e-9809-40c5-b0b8-d7cd63974df0 req-04dcdeb3-3cb9-4f2b-8e36-c3b3daaa22bf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035081 Jun 16 17:26:53.048593 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 286/577] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:11.262481 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b34bd146-c314-441d-86bd-445943b079e5 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:11.263053 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-b34bd146-c314-441d-86bd-445943b079e5 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:11.265835 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:11.266491 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:11.273904 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b34bd146-c314-441d-86bd-445943b079e5 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:11.274364 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b34bd146-c314-441d-86bd-445943b079e5 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:11.275117 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b34bd146-c314-441d-86bd-445943b079e5 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:11.275541 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b34bd146-c314-441d-86bd-445943b079e5 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:11.408306 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.objects.instance [None req-b34bd146-c314-441d-86bd-445943b079e5 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lazy-loading 'services' on Instance uuid 1394894f-f188-4863-8a8e-19e8498a38c0 {{(pid=117553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:27:11.530904 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b34bd146-c314-441d-86bd-445943b079e5 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0/os-volume_attachments/e4cecb90-ef78-466c-b291-209949913f3d" status: 202 len: 0 microversion: 2.1 time: 0.272262 Jun 16 17:27:11.531700 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 292/578] 10.222.0.66 () {58 vars in 1415 bytes} [Thu Jun 16 17:27:11 2022] DELETE /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0/os-volume_attachments/e4cecb90-ef78-466c-b291-209949913f3d => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:27:13.714898 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7f787958-35ae-41e1-b912-791dd2592e5c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:13.715534 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7f787958-35ae-41e1-b912-791dd2592e5c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:13.718022 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=57 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:13.718665 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=73 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:13.726784 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7f787958-35ae-41e1-b912-791dd2592e5c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:13.727376 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7f787958-35ae-41e1-b912-791dd2592e5c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:13.728169 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7f787958-35ae-41e1-b912-791dd2592e5c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:13.728603 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7f787958-35ae-41e1-b912-791dd2592e5c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:13.754585 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7f787958-35ae-41e1-b912-791dd2592e5c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Going to try to terminate instance {{(pid=117552) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:27:13.847266 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7f787958-35ae-41e1-b912-791dd2592e5c tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 204 len: 0 microversion: 2.1 time: 0.136346 Jun 16 17:27:13.847858 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 287/579] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:27:13 2022] DELETE /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:27:13.856827 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-243b009e-3625-42d7-84ed-dcaf806c9560 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:13.857621 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-243b009e-3625-42d7-84ed-dcaf806c9560 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:13.865195 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-243b009e-3625-42d7-84ed-dcaf806c9560 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:13.865649 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-243b009e-3625-42d7-84ed-dcaf806c9560 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:13.866484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-243b009e-3625-42d7-84ed-dcaf806c9560 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:13.866910 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-243b009e-3625-42d7-84ed-dcaf806c9560 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:14.017420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-243b009e-3625-42d7-84ed-dcaf806c9560 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:14.026162 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-243b009e-3625-42d7-84ed-dcaf806c9560 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1514 microversion: 2.1 time: 0.173599 Jun 16 17:27:14.026728 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 293/580] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:13 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:15.047417 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-697544b5-9616-417b-917d-9e253e90ff5b tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:15.048076 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-697544b5-9616-417b-917d-9e253e90ff5b tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:15.055067 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-697544b5-9616-417b-917d-9e253e90ff5b tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:15.055494 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-697544b5-9616-417b-917d-9e253e90ff5b tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:15.056251 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-697544b5-9616-417b-917d-9e253e90ff5b tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:15.056670 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-697544b5-9616-417b-917d-9e253e90ff5b tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:15.201428 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-697544b5-9616-417b-917d-9e253e90ff5b tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:15.209285 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-697544b5-9616-417b-917d-9e253e90ff5b tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1514 microversion: 2.1 time: 0.168277 Jun 16 17:27:15.209932 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 288/581] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:15 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:16.227075 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f1a5a429-ff7e-4aea-86c7-968a10314320 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:16.227691 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f1a5a429-ff7e-4aea-86c7-968a10314320 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:16.234524 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f1a5a429-ff7e-4aea-86c7-968a10314320 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:16.235288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f1a5a429-ff7e-4aea-86c7-968a10314320 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:16.236045 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f1a5a429-ff7e-4aea-86c7-968a10314320 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:16.236470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f1a5a429-ff7e-4aea-86c7-968a10314320 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:16.390808 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-f1a5a429-ff7e-4aea-86c7-968a10314320 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:16.399492 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f1a5a429-ff7e-4aea-86c7-968a10314320 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1514 microversion: 2.1 time: 0.176414 Jun 16 17:27:16.400073 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 294/582] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:16 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:16.893819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-46da0e0c-9fe4-4e1d-8b56-1cabaae9397f req-848ac640-2d23-4632-81a3-c2513f81f403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1394894f-f188-4863-8a8e-19e8498a38c0", "name": "network-vif-deleted", "tag": "2e065346-bbf2-4d07-9223-ade0165e1288"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:16.902978 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-46da0e0c-9fe4-4e1d-8b56-1cabaae9397f req-848ac640-2d23-4632-81a3-c2513f81f403 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:16.903414 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-46da0e0c-9fe4-4e1d-8b56-1cabaae9397f req-848ac640-2d23-4632-81a3-c2513f81f403 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:16.915742 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-46da0e0c-9fe4-4e1d-8b56-1cabaae9397f req-848ac640-2d23-4632-81a3-c2513f81f403 service nova] Creating event network-vif-deleted:2e065346-bbf2-4d07-9223-ade0165e1288 for instance 1394894f-f188-4863-8a8e-19e8498a38c0 on hv-cinder-83735 Jun 16 17:27:16.921099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-46da0e0c-9fe4-4e1d-8b56-1cabaae9397f req-848ac640-2d23-4632-81a3-c2513f81f403 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031639 Jun 16 17:27:16.921952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 289/583] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:17.417517 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-dee772c6-fe7c-497f-ba7b-e21946e69c93 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:17.418087 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-dee772c6-fe7c-497f-ba7b-e21946e69c93 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:17.425316 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-dee772c6-fe7c-497f-ba7b-e21946e69c93 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:17.425762 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-dee772c6-fe7c-497f-ba7b-e21946e69c93 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:17.426545 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-dee772c6-fe7c-497f-ba7b-e21946e69c93 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:17.427176 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-dee772c6-fe7c-497f-ba7b-e21946e69c93 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:17.461788 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-dee772c6-fe7c-497f-ba7b-e21946e69c93 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:17.462228 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-dee772c6-fe7c-497f-ba7b-e21946e69c93 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:17.462659 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.objects.instance [None req-dee772c6-fe7c-497f-ba7b-e21946e69c93 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lazy-loading 'fault' on Instance uuid 1394894f-f188-4863-8a8e-19e8498a38c0 {{(pid=117553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:27:17.518502 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-dee772c6-fe7c-497f-ba7b-e21946e69c93 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b088ae5ce5046ae83d9ae151dc52eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96239e8e212410aac9df2d35293c665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:17.527096 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-dee772c6-fe7c-497f-ba7b-e21946e69c93 tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 200 len: 1308 microversion: 2.1 time: 0.114185 Jun 16 17:27:17.527655 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 295/584] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:17 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:18.545056 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e420e1d1-8b6a-458d-ae92-a4d407c1f6fc tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:18.545789 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e420e1d1-8b6a-458d-ae92-a4d407c1f6fc tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] [instance: 1394894f-f188-4863-8a8e-19e8498a38c0] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:18.552294 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e420e1d1-8b6a-458d-ae92-a4d407c1f6fc tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:18.552739 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e420e1d1-8b6a-458d-ae92-a4d407c1f6fc tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:18.553565 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e420e1d1-8b6a-458d-ae92-a4d407c1f6fc tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:18.553990 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e420e1d1-8b6a-458d-ae92-a4d407c1f6fc tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:18.568032 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-e420e1d1-8b6a-458d-ae92-a4d407c1f6fc tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] HTTP exception thrown: Instance 1394894f-f188-4863-8a8e-19e8498a38c0 could not be found. Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e420e1d1-8b6a-458d-ae92-a4d407c1f6fc tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Request method failure captured: Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 HTTP/1.1 Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2dkGjFW1K4vCbDuBs1cQR2QF8ujl-iguR-7NCtPY0ZiMl4v8DvbXwtMfGH5b6g96aIDObACJIbAovaAlTLwCQBK70Mt2dM44QeVjI6NBpsHzZWMMVPwl6WJ94-bWW_4MusLhcIfyR11WUHGruJaveiUF6JzUenaTo2ZHaSu4MSmlJU Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: f96239e8e212410aac9df2d35293c665 Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-VolumesSnapshotTestJSON-385000497 Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:27:18.569723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:27:18.571362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f96239e8e212410aac9df2d35293c665"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f96239e8e212410aac9df2d35293c665"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f96239e8e212410aac9df2d35293c665", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f96239e8e212410aac9df2d35293c665"}]}] Jun 16 17:27:18.571362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-VolumesSnapshotTestJSON-385000497 Jun 16 17:27:18.571362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: f96239e8e212410aac9df2d35293c665 Jun 16 17:27:18.571362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-385000497 Jun 16 17:27:18.571362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-VolumesSnapshotTestJSON-385000497-project Jun 16 17:27:18.571362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:27:18.571362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:27:18.571362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 8b088ae5ce5046ae83d9ae151dc52eca Jun 16 17:27:18.571362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-VolumesSnapshotTestJSON-385000497-project Jun 16 17:27:18.571362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:27:18.571362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance 1394894f-f188-4863-8a8e-19e8498a38c0 could not be found. Jun 16 17:27:18.571362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': '1394894f-f188-4863-8a8e-19e8498a38c0'} Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1394894f-f188-4863-8a8e-19e8498a38c0 could not be found. Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:27:18.572271 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1394894f-f188-4863-8a8e-19e8498a38c0 could not be found. Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1394894f-f188-4863-8a8e-19e8498a38c0 could not be found. Jun 16 17:27:18.573856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:27:18.575209 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e420e1d1-8b6a-458d-ae92-a4d407c1f6fc tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] Returning 404 to user: Instance 1394894f-f188-4863-8a8e-19e8498a38c0 could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:27:18.575209 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-e420e1d1-8b6a-458d-ae92-a4d407c1f6fc tempest-VolumesSnapshotTestJSON-385000497 tempest-VolumesSnapshotTestJSON-385000497-project] 10.222.0.66 "GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0" status: 404 len: 111 microversion: 2.1 time: 0.030998 Jun 16 17:27:18.575209 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 290/585] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:18 2022] GET /compute/v2.1/servers/1394894f-f188-4863-8a8e-19e8498a38c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:27:29.100518 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f9c42b3a-e733-4544-af2e-3d2f4dc6f5f2 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:29.102505 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f9c42b3a-e733-4544-af2e-3d2f4dc6f5f2 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:29.106530 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=10 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:29.107320 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:29.117241 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f9c42b3a-e733-4544-af2e-3d2f4dc6f5f2 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:29.117956 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f9c42b3a-e733-4544-af2e-3d2f4dc6f5f2 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:29.118943 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f9c42b3a-e733-4544-af2e-3d2f4dc6f5f2 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:29.119474 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f9c42b3a-e733-4544-af2e-3d2f4dc6f5f2 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:29.206199 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f9c42b3a-e733-4544-af2e-3d2f4dc6f5f2 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "POST /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54/action" status: 202 len: 0 microversion: 2.1 time: 0.112219 Jun 16 17:27:29.210580 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 296/586] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jun 16 17:27:29 2022] POST /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:27:29.218061 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d2e21527-8ce8-4fa3-957a-9cd91dd226ab tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:29.218758 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d2e21527-8ce8-4fa3-957a-9cd91dd226ab tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:29.221676 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:29.222587 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:29.229134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d2e21527-8ce8-4fa3-957a-9cd91dd226ab tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:29.229636 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d2e21527-8ce8-4fa3-957a-9cd91dd226ab tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:29.230643 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d2e21527-8ce8-4fa3-957a-9cd91dd226ab tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:29.231070 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d2e21527-8ce8-4fa3-957a-9cd91dd226ab tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:29.401256 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d2e21527-8ce8-4fa3-957a-9cd91dd226ab tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:29.409794 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d2e21527-8ce8-4fa3-957a-9cd91dd226ab tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1753 microversion: 2.1 time: 0.197711 Jun 16 17:27:29.410361 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 291/587] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:29 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1753 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:30.428903 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4abcd59b-e0dc-417e-afd8-0b214d546840 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:30.429420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4abcd59b-e0dc-417e-afd8-0b214d546840 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:30.436481 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4abcd59b-e0dc-417e-afd8-0b214d546840 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:30.436917 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4abcd59b-e0dc-417e-afd8-0b214d546840 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:30.437735 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4abcd59b-e0dc-417e-afd8-0b214d546840 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:30.438162 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4abcd59b-e0dc-417e-afd8-0b214d546840 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:30.603617 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4abcd59b-e0dc-417e-afd8-0b214d546840 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:30.614592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4abcd59b-e0dc-417e-afd8-0b214d546840 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1753 microversion: 2.1 time: 0.190783 Jun 16 17:27:30.615163 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 297/588] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:30 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1753 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:31.632905 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-22a751fa-1976-4189-9b09-4e711ec83bf0 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:31.633580 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-22a751fa-1976-4189-9b09-4e711ec83bf0 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:31.640530 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-22a751fa-1976-4189-9b09-4e711ec83bf0 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:31.640980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-22a751fa-1976-4189-9b09-4e711ec83bf0 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:31.641803 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-22a751fa-1976-4189-9b09-4e711ec83bf0 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:31.642235 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-22a751fa-1976-4189-9b09-4e711ec83bf0 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:31.901433 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-22a751fa-1976-4189-9b09-4e711ec83bf0 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:31.910718 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-22a751fa-1976-4189-9b09-4e711ec83bf0 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1753 microversion: 2.1 time: 0.282031 Jun 16 17:27:31.911311 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 292/589] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:31 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1753 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:27:32.928113 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a9f3b13f-18af-4359-9fde-4fdf67430372 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:32.928725 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a9f3b13f-18af-4359-9fde-4fdf67430372 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:32.935397 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a9f3b13f-18af-4359-9fde-4fdf67430372 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:32.935828 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a9f3b13f-18af-4359-9fde-4fdf67430372 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:32.936587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a9f3b13f-18af-4359-9fde-4fdf67430372 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:32.937011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a9f3b13f-18af-4359-9fde-4fdf67430372 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:33.111125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a9f3b13f-18af-4359-9fde-4fdf67430372 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:33.120230 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a9f3b13f-18af-4359-9fde-4fdf67430372 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1758 microversion: 2.1 time: 0.195962 Jun 16 17:27:33.120709 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 298/590] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:32 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1758 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:34.138415 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-90c5701e-3c53-4cab-87fc-921dd283ec22 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:34.138999 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-90c5701e-3c53-4cab-87fc-921dd283ec22 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:34.146047 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-90c5701e-3c53-4cab-87fc-921dd283ec22 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:34.146464 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-90c5701e-3c53-4cab-87fc-921dd283ec22 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:34.147321 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-90c5701e-3c53-4cab-87fc-921dd283ec22 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:34.147742 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-90c5701e-3c53-4cab-87fc-921dd283ec22 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:34.322425 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-90c5701e-3c53-4cab-87fc-921dd283ec22 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:34.330900 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-90c5701e-3c53-4cab-87fc-921dd283ec22 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1758 microversion: 2.1 time: 0.196518 Jun 16 17:27:34.331672 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 293/591] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:34 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1758 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:35.354396 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7989c918-c001-4846-b684-3c8fdd74628f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:35.354960 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-7989c918-c001-4846-b684-3c8fdd74628f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:35.362198 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7989c918-c001-4846-b684-3c8fdd74628f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:35.362671 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7989c918-c001-4846-b684-3c8fdd74628f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:35.363463 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7989c918-c001-4846-b684-3c8fdd74628f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:35.363905 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7989c918-c001-4846-b684-3c8fdd74628f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:35.533088 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7989c918-c001-4846-b684-3c8fdd74628f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:35.546556 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7989c918-c001-4846-b684-3c8fdd74628f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1758 microversion: 2.1 time: 0.196900 Jun 16 17:27:35.547144 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 299/592] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:35 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1758 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:36.565908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-94083f24-5826-44d0-8cb4-88a009daf036 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:36.566486 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-94083f24-5826-44d0-8cb4-88a009daf036 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:36.573558 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-94083f24-5826-44d0-8cb4-88a009daf036 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:36.574023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-94083f24-5826-44d0-8cb4-88a009daf036 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:36.574776 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-94083f24-5826-44d0-8cb4-88a009daf036 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:36.575196 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-94083f24-5826-44d0-8cb4-88a009daf036 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:36.736666 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-94083f24-5826-44d0-8cb4-88a009daf036 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:36.746367 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-94083f24-5826-44d0-8cb4-88a009daf036 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1758 microversion: 2.1 time: 0.185111 Jun 16 17:27:36.746945 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 294/593] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:36 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:37.765723 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a81a22dc-4fb8-47e7-9709-8e935bd7644c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:37.766735 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a81a22dc-4fb8-47e7-9709-8e935bd7644c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:37.773959 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a81a22dc-4fb8-47e7-9709-8e935bd7644c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:37.774491 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a81a22dc-4fb8-47e7-9709-8e935bd7644c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:37.775696 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a81a22dc-4fb8-47e7-9709-8e935bd7644c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:37.776321 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a81a22dc-4fb8-47e7-9709-8e935bd7644c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:37.939103 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a81a22dc-4fb8-47e7-9709-8e935bd7644c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:37.947460 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a81a22dc-4fb8-47e7-9709-8e935bd7644c tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1758 microversion: 2.1 time: 0.186702 Jun 16 17:27:37.948007 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 300/594] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:37 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:38.552409 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-af98442d-0b5f-407e-91f1-e6d7d528a9d7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:38.553035 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-af98442d-0b5f-407e-91f1-e6d7d528a9d7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:38.562909 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-af98442d-0b5f-407e-91f1-e6d7d528a9d7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:38.563518 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-af98442d-0b5f-407e-91f1-e6d7d528a9d7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:38.564838 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-af98442d-0b5f-407e-91f1-e6d7d528a9d7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:38.565548 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-af98442d-0b5f-407e-91f1-e6d7d528a9d7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:38.600290 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-af98442d-0b5f-407e-91f1-e6d7d528a9d7 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/os-volume_attachments/6ca60a11-11cb-47e7-a1db-8cc9a8aebc85" status: 200 len: 194 microversion: 2.20 time: 0.052086 Jun 16 17:27:38.601311 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 295/595] 10.222.0.66 () {60 vars in 1453 bytes} [Thu Jun 16 17:27:38 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/os-volume_attachments/6ca60a11-11cb-47e7-a1db-8cc9a8aebc85 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:27:38.671848 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-e6bb0ea1-53dd-44f0-9b6f-48e26f9f394c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:38.672654 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-e6bb0ea1-53dd-44f0-9b6f-48e26f9f394c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:38.681029 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e6bb0ea1-53dd-44f0-9b6f-48e26f9f394c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:38.681708 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e6bb0ea1-53dd-44f0-9b6f-48e26f9f394c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:38.682476 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e6bb0ea1-53dd-44f0-9b6f-48e26f9f394c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:38.682913 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e6bb0ea1-53dd-44f0-9b6f-48e26f9f394c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:38.803556 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.objects.instance [None req-e6bb0ea1-53dd-44f0-9b6f-48e26f9f394c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lazy-loading 'services' on Instance uuid ab2e7148-fa86-4648-9e4b-87e27fcf1147 {{(pid=117553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:27:38.888495 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-e6bb0ea1-53dd-44f0-9b6f-48e26f9f394c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/os-volume_attachments/6ca60a11-11cb-47e7-a1db-8cc9a8aebc85" status: 202 len: 0 microversion: 2.20 time: 0.220624 Jun 16 17:27:38.889439 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 301/596] 10.222.0.66 () {60 vars in 1456 bytes} [Thu Jun 16 17:27:38 2022] DELETE /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/os-volume_attachments/6ca60a11-11cb-47e7-a1db-8cc9a8aebc85 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:27:38.900069 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8aec9613-4b4f-43d0-9d73-ba91ad262223 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:38.901103 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8aec9613-4b4f-43d0-9d73-ba91ad262223 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:38.908782 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8aec9613-4b4f-43d0-9d73-ba91ad262223 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:38.909315 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8aec9613-4b4f-43d0-9d73-ba91ad262223 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:38.910390 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8aec9613-4b4f-43d0-9d73-ba91ad262223 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:38.910868 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8aec9613-4b4f-43d0-9d73-ba91ad262223 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:38.961638 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8aec9613-4b4f-43d0-9d73-ba91ad262223 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066648 Jun 16 17:27:38.962700 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 296/597] 10.222.0.66 () {60 vars in 1342 bytes} [Thu Jun 16 17:27:38 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:27:38.971638 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-83ae7e02-d8de-42a2-a824-4a431851d22f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:38.972566 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-83ae7e02-d8de-42a2-a824-4a431851d22f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:38.981530 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-83ae7e02-d8de-42a2-a824-4a431851d22f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:38.982180 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-83ae7e02-d8de-42a2-a824-4a431851d22f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:38.983040 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-83ae7e02-d8de-42a2-a824-4a431851d22f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:38.983536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-83ae7e02-d8de-42a2-a824-4a431851d22f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:39.162761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-83ae7e02-d8de-42a2-a824-4a431851d22f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:39.172787 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-83ae7e02-d8de-42a2-a824-4a431851d22f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1758 microversion: 2.1 time: 0.211660 Jun 16 17:27:39.173409 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 302/598] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:38 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1758 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:39.976136 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-eba45982-ba05-47e7-8f27-00fff2fe7012 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:39.977481 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-eba45982-ba05-47e7-8f27-00fff2fe7012 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:39.988156 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-eba45982-ba05-47e7-8f27-00fff2fe7012 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:39.988902 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-eba45982-ba05-47e7-8f27-00fff2fe7012 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:39.990264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-eba45982-ba05-47e7-8f27-00fff2fe7012 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:39.991152 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-eba45982-ba05-47e7-8f27-00fff2fe7012 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:40.032448 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-eba45982-ba05-47e7-8f27-00fff2fe7012 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061247 Jun 16 17:27:40.033005 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 297/599] 10.222.0.66 () {60 vars in 1342 bytes} [Thu Jun 16 17:27:39 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:40.095004 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ad9fdec4-1d8d-4071-b21d-a42f231956cb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:40.095560 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ad9fdec4-1d8d-4071-b21d-a42f231956cb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:40.102358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ad9fdec4-1d8d-4071-b21d-a42f231956cb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:40.102789 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ad9fdec4-1d8d-4071-b21d-a42f231956cb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:40.103538 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ad9fdec4-1d8d-4071-b21d-a42f231956cb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:40.103959 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ad9fdec4-1d8d-4071-b21d-a42f231956cb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:40.131730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ad9fdec4-1d8d-4071-b21d-a42f231956cb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Going to try to terminate instance {{(pid=117553) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:27:40.190626 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7963dc1c-6c1d-4835-9b68-1eadb61f7d94 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:40.191327 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7963dc1c-6c1d-4835-9b68-1eadb61f7d94 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:40.198939 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7963dc1c-6c1d-4835-9b68-1eadb61f7d94 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:40.199394 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7963dc1c-6c1d-4835-9b68-1eadb61f7d94 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:40.200482 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7963dc1c-6c1d-4835-9b68-1eadb61f7d94 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:40.200935 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7963dc1c-6c1d-4835-9b68-1eadb61f7d94 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:40.219057 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ad9fdec4-1d8d-4071-b21d-a42f231956cb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 204 len: 0 microversion: 2.20 time: 0.127769 Jun 16 17:27:40.219653 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 303/600] 10.222.0.66 () {60 vars in 1279 bytes} [Thu Jun 16 17:27:40 2022] DELETE /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 17:27:40.229826 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-682fc6b9-d8f9-4318-bc32-b221f98232dd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:40.230906 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-682fc6b9-d8f9-4318-bc32-b221f98232dd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:40.237528 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-682fc6b9-d8f9-4318-bc32-b221f98232dd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:40.237976 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-682fc6b9-d8f9-4318-bc32-b221f98232dd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:40.238748 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-682fc6b9-d8f9-4318-bc32-b221f98232dd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:40.239180 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-682fc6b9-d8f9-4318-bc32-b221f98232dd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:40.425560 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7963dc1c-6c1d-4835-9b68-1eadb61f7d94 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:40.434902 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7963dc1c-6c1d-4835-9b68-1eadb61f7d94 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1758 microversion: 2.1 time: 0.248343 Jun 16 17:27:40.435479 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 298/601] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:40 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1758 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:40.447644 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-682fc6b9-d8f9-4318-bc32-b221f98232dd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:40.456531 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-682fc6b9-d8f9-4318-bc32-b221f98232dd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:40.458029 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-682fc6b9-d8f9-4318-bc32-b221f98232dd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:40.459172 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-682fc6b9-d8f9-4318-bc32-b221f98232dd tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1721 microversion: 2.20 time: 0.234534 Jun 16 17:27:40.459765 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 304/602] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:27:40 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:41.457428 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-1d20a5ec-9d6f-4818-b4e5-c491d77788cb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:41.458052 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-1d20a5ec-9d6f-4818-b4e5-c491d77788cb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:41.465463 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1d20a5ec-9d6f-4818-b4e5-c491d77788cb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:41.465821 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1d20a5ec-9d6f-4818-b4e5-c491d77788cb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:41.466588 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1d20a5ec-9d6f-4818-b4e5-c491d77788cb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:41.467018 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1d20a5ec-9d6f-4818-b4e5-c491d77788cb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:41.478282 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-97237d87-6f24-42b2-a322-6c41a1bd7919 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:41.478894 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-97237d87-6f24-42b2-a322-6c41a1bd7919 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:41.487140 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-97237d87-6f24-42b2-a322-6c41a1bd7919 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:41.487937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-97237d87-6f24-42b2-a322-6c41a1bd7919 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:41.488634 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-97237d87-6f24-42b2-a322-6c41a1bd7919 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:41.489286 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-97237d87-6f24-42b2-a322-6c41a1bd7919 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:41.635659 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-1d20a5ec-9d6f-4818-b4e5-c491d77788cb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:41.643614 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-97237d87-6f24-42b2-a322-6c41a1bd7919 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:41.645073 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-1d20a5ec-9d6f-4818-b4e5-c491d77788cb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1758 microversion: 2.1 time: 0.193259 Jun 16 17:27:41.645706 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 299/603] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:41 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:41.652952 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-97237d87-6f24-42b2-a322-6c41a1bd7919 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:41.654681 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-97237d87-6f24-42b2-a322-6c41a1bd7919 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:41.656290 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-97237d87-6f24-42b2-a322-6c41a1bd7919 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1721 microversion: 2.20 time: 0.181855 Jun 16 17:27:41.656951 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 305/604] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:27:41 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:42.664460 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9510f87b-17e4-4965-93c0-07bb19c84f5a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:42.664852 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-9510f87b-17e4-4965-93c0-07bb19c84f5a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:42.671763 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9510f87b-17e4-4965-93c0-07bb19c84f5a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:42.672215 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9510f87b-17e4-4965-93c0-07bb19c84f5a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:42.673729 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9510f87b-17e4-4965-93c0-07bb19c84f5a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:42.674226 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9510f87b-17e4-4965-93c0-07bb19c84f5a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:42.686350 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-fad44b6e-0c2f-4e32-93de-f417e9ca2d27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:42.687632 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-fad44b6e-0c2f-4e32-93de-f417e9ca2d27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:42.700405 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fad44b6e-0c2f-4e32-93de-f417e9ca2d27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:42.701081 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fad44b6e-0c2f-4e32-93de-f417e9ca2d27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:42.702110 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fad44b6e-0c2f-4e32-93de-f417e9ca2d27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:42.702778 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fad44b6e-0c2f-4e32-93de-f417e9ca2d27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:42.943568 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9510f87b-17e4-4965-93c0-07bb19c84f5a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:42.955023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9510f87b-17e4-4965-93c0-07bb19c84f5a tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1758 microversion: 2.1 time: 0.295455 Jun 16 17:27:42.956235 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 300/605] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:42 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1758 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:43.199146 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-fad44b6e-0c2f-4e32-93de-f417e9ca2d27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:43.207853 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-fad44b6e-0c2f-4e32-93de-f417e9ca2d27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:43.209573 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-fad44b6e-0c2f-4e32-93de-f417e9ca2d27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:43.211202 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-fad44b6e-0c2f-4e32-93de-f417e9ca2d27 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1721 microversion: 2.20 time: 0.539494 Jun 16 17:27:43.221798 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 306/606] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:27:42 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1721 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:43.578661 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:27:43.578983 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Thu Jun 16 17:27:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:27:43.776190 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-c26c2f7c-555e-4fd2-8a5f-75cf499e04b4 req-d0751534-6f91-4190-9546-dfa9e92a5817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2e7148-fa86-4648-9e4b-87e27fcf1147", "name": "network-vif-deleted", "tag": "2da50d5c-d328-4853-a261-6bd0c6378dcd"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:43.784965 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-c26c2f7c-555e-4fd2-8a5f-75cf499e04b4 req-d0751534-6f91-4190-9546-dfa9e92a5817 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:43.785454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-c26c2f7c-555e-4fd2-8a5f-75cf499e04b4 req-d0751534-6f91-4190-9546-dfa9e92a5817 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:43.804695 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-c26c2f7c-555e-4fd2-8a5f-75cf499e04b4 req-d0751534-6f91-4190-9546-dfa9e92a5817 service nova] Creating event network-vif-deleted:2da50d5c-d328-4853-a261-6bd0c6378dcd for instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 on hv-cinder-83735 Jun 16 17:27:43.810755 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-c26c2f7c-555e-4fd2-8a5f-75cf499e04b4 req-d0751534-6f91-4190-9546-dfa9e92a5817 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039175 Jun 16 17:27:43.811352 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 301/607] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:43.973779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-575ae514-4afb-4bfd-82ad-1146c676b6fd tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:43.974344 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-575ae514-4afb-4bfd-82ad-1146c676b6fd tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:43.983143 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-575ae514-4afb-4bfd-82ad-1146c676b6fd tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:43.983623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-575ae514-4afb-4bfd-82ad-1146c676b6fd tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:43.984398 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-575ae514-4afb-4bfd-82ad-1146c676b6fd tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:43.984827 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-575ae514-4afb-4bfd-82ad-1146c676b6fd tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:44.164656 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-575ae514-4afb-4bfd-82ad-1146c676b6fd tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:44.173830 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-575ae514-4afb-4bfd-82ad-1146c676b6fd tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1758 microversion: 2.1 time: 0.204151 Jun 16 17:27:44.174442 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 307/608] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:43 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1758 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:27:44.236088 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-2ca2723e-417b-45e4-81ab-96141b952b05 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:44.236878 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-2ca2723e-417b-45e4-81ab-96141b952b05 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:44.244360 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2ca2723e-417b-45e4-81ab-96141b952b05 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:44.244788 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2ca2723e-417b-45e4-81ab-96141b952b05 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:44.245596 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2ca2723e-417b-45e4-81ab-96141b952b05 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:44.246019 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2ca2723e-417b-45e4-81ab-96141b952b05 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:44.281526 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2ca2723e-417b-45e4-81ab-96141b952b05 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:44.281748 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2ca2723e-417b-45e4-81ab-96141b952b05 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:44.282197 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.objects.instance [None req-2ca2723e-417b-45e4-81ab-96141b952b05 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lazy-loading 'fault' on Instance uuid ab2e7148-fa86-4648-9e4b-87e27fcf1147 {{(pid=117552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:27:44.331575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2ca2723e-417b-45e4-81ab-96141b952b05 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:44.341562 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2ca2723e-417b-45e4-81ab-96141b952b05 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:44.343798 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2ca2723e-417b-45e4-81ab-96141b952b05 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:44.344999 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-2ca2723e-417b-45e4-81ab-96141b952b05 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 200 len: 1368 microversion: 2.20 time: 0.116404 Jun 16 17:27:44.345570 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 302/609] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:27:44 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 1368 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:45.194948 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-bfd6cd50-af01-4c2b-a58f-63cd03b09e3b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:45.195554 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-bfd6cd50-af01-4c2b-a58f-63cd03b09e3b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:45.204353 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bfd6cd50-af01-4c2b-a58f-63cd03b09e3b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:45.204789 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bfd6cd50-af01-4c2b-a58f-63cd03b09e3b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:45.205600 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bfd6cd50-af01-4c2b-a58f-63cd03b09e3b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:45.206022 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bfd6cd50-af01-4c2b-a58f-63cd03b09e3b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:45.365342 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d5eec82e-0049-445a-b040-9619dd254b23 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:45.366501 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d5eec82e-0049-445a-b040-9619dd254b23 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:45.367885 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-bfd6cd50-af01-4c2b-a58f-63cd03b09e3b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:45.373153 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d5eec82e-0049-445a-b040-9619dd254b23 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:45.373748 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d5eec82e-0049-445a-b040-9619dd254b23 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:45.374728 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d5eec82e-0049-445a-b040-9619dd254b23 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:45.375158 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d5eec82e-0049-445a-b040-9619dd254b23 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:45.376358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-bfd6cd50-af01-4c2b-a58f-63cd03b09e3b tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1758 microversion: 2.1 time: 0.185584 Jun 16 17:27:45.376927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 308/610] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:45 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:45.392032 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-d5eec82e-0049-445a-b040-9619dd254b23 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] HTTP exception thrown: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d5eec82e-0049-445a-b040-9619dd254b23 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Request method failure captured: Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 HTTP/1.1 Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2bfTXNo5hz210hfDVTooV9B1XlfPcDbJKJPiY4aZgYrbHAzM2zrs84fJ6e071Btm_k4-ojg7XeO63ExW_kdVhPPh1Cl2HGlD6dBExPO_vKXg7U-KHzqQQpc09nDEA5A77D9smA85likTwu19sn114gA3WCam9FU0n7MCDf73zEyqt8 Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 0c63f648631a4a11910b4b135f22b235 Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:27:45.393733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:27:45.395490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c63f648631a4a11910b4b135f22b235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c63f648631a4a11910b4b135f22b235"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0c63f648631a4a11910b4b135f22b235", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0c63f648631a4a11910b4b135f22b235"}]}] Jun 16 17:27:45.395490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:27:45.395490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 0c63f648631a4a11910b4b135f22b235 Jun 16 17:27:45.395490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:27:45.395490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-AttachVolumeShelveTestJSON-1123487845-project Jun 16 17:27:45.395490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:27:45.395490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:27:45.395490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 68da2fd51cc84b2b8d641e1e6ac17c72 Jun 16 17:27:45.395490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1123487845-project Jun 16 17:27:45.395490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:27:45.395490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. Jun 16 17:27:45.395490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': 'ab2e7148-fa86-4648-9e4b-87e27fcf1147'} Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:27:45.396379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. Jun 16 17:27:45.398743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:27:45.400220 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d5eec82e-0049-445a-b040-9619dd254b23 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Returning 404 to user: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:27:45.400220 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d5eec82e-0049-445a-b040-9619dd254b23 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 404 len: 111 microversion: 2.20 time: 0.034937 Jun 16 17:27:45.400220 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 303/611] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:27:45 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:27:45.406626 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b1a457ef-82eb-44fb-98b6-6e162a12c049 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '.version_select at 0x7f66b14e2d30>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:45.440706 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b1a457ef-82eb-44fb-98b6-6e162a12c049 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-902250" status: 204 len: 0 microversion: 2.20 time: 0.039652 Jun 16 17:27:45.441320 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 309/612] 10.222.0.66 () {60 vars in 1249 bytes} [Thu Jun 16 17:27:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-902250 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 17:27:46.172146 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-642d07a2-7a8a-4de9-850a-aa5692470562 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Action: 'create', calling method: .version_select at 0x7f66b15b1dc0>, body: {"keypair": {"name": "tempest-keypair-1256609393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIv4xkLHDnOmexPyqVdASHkQIR8Wy35wssQyTjzYieVst0hovzKfTVKdHcY+6esJ1Eqyg9Ga57JjmMI7rUS930+fGPteTR00SS1qDqjJUJyUgfE8eob7SubNFVnfevFYw=="}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:46.187783 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-642d07a2-7a8a-4de9-850a-aa5692470562 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Getting quotas for project 0c63f648631a4a11910b4b135f22b235. Resources: {'key_pairs'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:27:46.191694 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-642d07a2-7a8a-4de9-850a-aa5692470562 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Getting quotas for user 68da2fd51cc84b2b8d641e1e6ac17c72 and project 0c63f648631a4a11910b4b135f22b235. Resources: {'key_pairs'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:27:46.216799 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-642d07a2-7a8a-4de9-850a-aa5692470562 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048601 Jun 16 17:27:46.217428 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 304/613] 10.222.0.66 () {62 vars in 1199 bytes} [Thu Jun 16 17:27:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 17:27:46.396572 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2e63ce3e-200e-4802-b8bc-277863dc98a5 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:46.397518 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2e63ce3e-200e-4802-b8bc-277863dc98a5 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:46.405170 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2e63ce3e-200e-4802-b8bc-277863dc98a5 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:46.406068 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2e63ce3e-200e-4802-b8bc-277863dc98a5 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:46.407411 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2e63ce3e-200e-4802-b8bc-277863dc98a5 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:46.408154 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2e63ce3e-200e-4802-b8bc-277863dc98a5 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:46.413948 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:46.651814 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2e63ce3e-200e-4802-b8bc-277863dc98a5 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:46.663049 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2e63ce3e-200e-4802-b8bc-277863dc98a5 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1758 microversion: 2.1 time: 0.270950 Jun 16 17:27:46.663938 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 310/614] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:46 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1758 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:27:47.681524 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-58161a23-a03a-450a-83a6-3c3810968b65 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:47.682132 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-58161a23-a03a-450a-83a6-3c3810968b65 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:47.688477 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-58161a23-a03a-450a-83a6-3c3810968b65 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:47.688919 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-58161a23-a03a-450a-83a6-3c3810968b65 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:47.689719 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-58161a23-a03a-450a-83a6-3c3810968b65 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:47.690200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-58161a23-a03a-450a-83a6-3c3810968b65 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:47.766843 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5b240db5-7930-49e1-9748-63e35d049f77 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1836307266", "imageRef": "c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04f2ecf4-cd9f-483b-9100-6d9d67a561d2"}], "security_groups": [{"name": "tempest-securitygroup--1497211005"}], "key_name": "tempest-keypair-1256609393", "user_data": "}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:47.859363 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-58161a23-a03a-450a-83a6-3c3810968b65 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:47.868651 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-58161a23-a03a-450a-83a6-3c3810968b65 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1758 microversion: 2.1 time: 0.191933 Jun 16 17:27:47.869279 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 305/615] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:47 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1758 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:47.881186 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.network.neutron [None req-5b240db5-7930-49e1-9748-63e35d049f77 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] validate_networks() for [('04f2ecf4-cd9f-483b-9100-6d9d67a561d2', None, None, None, None, None)] {{(pid=117553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:27:48.379943 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-5b240db5-7930-49e1-9748-63e35d049f77 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Flavor limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:27:48.380391 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-5b240db5-7930-49e1-9748-63e35d049f77 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Image limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:27:48.380859 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-5b240db5-7930-49e1-9748-63e35d049f77 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Flavor pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:27:48.381531 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-5b240db5-7930-49e1-9748-63e35d049f77 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Image pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:27:48.382715 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-5b240db5-7930-49e1-9748-63e35d049f77 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:27:48.392919 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5b240db5-7930-49e1-9748-63e35d049f77 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:48.393530 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5b240db5-7930-49e1-9748-63e35d049f77 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:48.394335 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5b240db5-7930-49e1-9748-63e35d049f77 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:48.394794 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5b240db5-7930-49e1-9748-63e35d049f77 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:48.414238 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-5b240db5-7930-49e1-9748-63e35d049f77 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Getting quotas for project 0c63f648631a4a11910b4b135f22b235. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:27:48.418982 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-5b240db5-7930-49e1-9748-63e35d049f77 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Getting quotas for user 68da2fd51cc84b2b8d641e1e6ac17c72 and project 0c63f648631a4a11910b4b135f22b235. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:27:48.438045 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5b240db5-7930-49e1-9748-63e35d049f77 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Going to run 1 instances... {{(pid=117553) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:27:48.440332 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5b240db5-7930-49e1-9748-63e35d049f77 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:27:48.491669 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5b240db5-7930-49e1-9748-63e35d049f77 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.729134 Jun 16 17:27:48.493111 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 311/616] 10.222.0.66 () {62 vars in 1187 bytes} [Thu Jun 16 17:27:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 16 17:27:48.503846 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c501e575-f613-4052-baa8-ffed0dbbbb9c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:48.504480 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c501e575-f613-4052-baa8-ffed0dbbbb9c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:48.566453 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c501e575-f613-4052-baa8-ffed0dbbbb9c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:48.577220 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c501e575-f613-4052-baa8-ffed0dbbbb9c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:48.579718 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c501e575-f613-4052-baa8-ffed0dbbbb9c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:48.580956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c501e575-f613-4052-baa8-ffed0dbbbb9c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1282 microversion: 2.20 time: 0.081097 Jun 16 17:27:48.581732 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 306/617] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:27:48 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1282 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:48.886201 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f0b6a9e2-a1f1-4284-9868-10f51e78df04 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:48.886913 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f0b6a9e2-a1f1-4284-9868-10f51e78df04 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:48.895680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f0b6a9e2-a1f1-4284-9868-10f51e78df04 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:48.897110 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f0b6a9e2-a1f1-4284-9868-10f51e78df04 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:48.898065 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f0b6a9e2-a1f1-4284-9868-10f51e78df04 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:48.898492 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f0b6a9e2-a1f1-4284-9868-10f51e78df04 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:49.083938 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-f0b6a9e2-a1f1-4284-9868-10f51e78df04 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:49.093608 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f0b6a9e2-a1f1-4284-9868-10f51e78df04 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1761 microversion: 2.1 time: 0.212000 Jun 16 17:27:49.094196 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 312/618] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:48 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1761 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:49.600398 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d7242642-fb1b-42e0-8392-865e1553953f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:49.601291 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d7242642-fb1b-42e0-8392-865e1553953f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:49.609970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d7242642-fb1b-42e0-8392-865e1553953f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:49.610716 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d7242642-fb1b-42e0-8392-865e1553953f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:49.611486 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d7242642-fb1b-42e0-8392-865e1553953f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:49.612555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d7242642-fb1b-42e0-8392-865e1553953f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:49.680204 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d7242642-fb1b-42e0-8392-865e1553953f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:49.694791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d7242642-fb1b-42e0-8392-865e1553953f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:49.697348 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d7242642-fb1b-42e0-8392-865e1553953f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:49.699075 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d7242642-fb1b-42e0-8392-865e1553953f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1334 microversion: 2.20 time: 0.102758 Jun 16 17:27:49.699852 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 307/619] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:27:49 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1334 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:50.722668 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-84ad5af8-f050-4d8e-bde1-792b9bab5814 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:50.723294 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-84ad5af8-f050-4d8e-bde1-792b9bab5814 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:50.728352 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c5b6b113-b8a9-4df2-a5a8-2769c6bca6c2 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:50.729402 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c5b6b113-b8a9-4df2-a5a8-2769c6bca6c2 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:50.731105 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-84ad5af8-f050-4d8e-bde1-792b9bab5814 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:50.731764 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-84ad5af8-f050-4d8e-bde1-792b9bab5814 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:50.732590 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-84ad5af8-f050-4d8e-bde1-792b9bab5814 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:50.733081 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-84ad5af8-f050-4d8e-bde1-792b9bab5814 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:50.737735 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c5b6b113-b8a9-4df2-a5a8-2769c6bca6c2 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:50.738267 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c5b6b113-b8a9-4df2-a5a8-2769c6bca6c2 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:50.739096 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c5b6b113-b8a9-4df2-a5a8-2769c6bca6c2 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:50.739530 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c5b6b113-b8a9-4df2-a5a8-2769c6bca6c2 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:50.776092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c5b6b113-b8a9-4df2-a5a8-2769c6bca6c2 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053219 Jun 16 17:27:50.777408 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 308/620] 10.222.0.66 () {58 vars in 1301 bytes} [Thu Jun 16 17:27:50 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 17:27:50.846422 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-1a24bacf-5ce6-4509-aa6b-92b3dfedfcce tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:50.846925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-1a24bacf-5ce6-4509-aa6b-92b3dfedfcce tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:50.853632 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1a24bacf-5ce6-4509-aa6b-92b3dfedfcce tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:50.854218 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1a24bacf-5ce6-4509-aa6b-92b3dfedfcce tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:50.855102 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1a24bacf-5ce6-4509-aa6b-92b3dfedfcce tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:50.855681 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1a24bacf-5ce6-4509-aa6b-92b3dfedfcce tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:50.885543 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-1a24bacf-5ce6-4509-aa6b-92b3dfedfcce tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Going to try to terminate instance {{(pid=117552) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:27:50.916376 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=100 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:50.979608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-1a24bacf-5ce6-4509-aa6b-92b3dfedfcce tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 204 len: 0 microversion: 2.1 time: 0.136938 Jun 16 17:27:50.980216 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 309/621] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:27:50 2022] DELETE /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:27:50.990678 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7513b2da-8bea-42be-9cd7-4913361f467f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:50.991389 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7513b2da-8bea-42be-9cd7-4913361f467f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:50.998373 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7513b2da-8bea-42be-9cd7-4913361f467f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:50.999279 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7513b2da-8bea-42be-9cd7-4913361f467f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:50.999944 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-84ad5af8-f050-4d8e-bde1-792b9bab5814 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:51.000352 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7513b2da-8bea-42be-9cd7-4913361f467f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:51.000792 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7513b2da-8bea-42be-9cd7-4913361f467f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:51.013231 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-84ad5af8-f050-4d8e-bde1-792b9bab5814 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:51.015466 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-84ad5af8-f050-4d8e-bde1-792b9bab5814 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:51.018068 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-84ad5af8-f050-4d8e-bde1-792b9bab5814 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1408 microversion: 2.20 time: 0.300369 Jun 16 17:27:51.020551 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 313/622] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:27:50 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1408 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:51.149128 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7513b2da-8bea-42be-9cd7-4913361f467f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:51.158708 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7513b2da-8bea-42be-9cd7-4913361f467f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1673 microversion: 2.1 time: 0.173576 Jun 16 17:27:51.159409 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 310/623] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:50 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:51.447768 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-68180fa8-78d4-4cff-8e1d-666d43bb188d req-251923fb-ab8d-499d-8b86-123759aa6903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4", "tag": "8d7a682c-8735-4554-a952-dc548868e5d9"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:51.458663 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-68180fa8-78d4-4cff-8e1d-666d43bb188d req-251923fb-ab8d-499d-8b86-123759aa6903 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:51.459551 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-68180fa8-78d4-4cff-8e1d-666d43bb188d req-251923fb-ab8d-499d-8b86-123759aa6903 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:51.486394 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-68180fa8-78d4-4cff-8e1d-666d43bb188d req-251923fb-ab8d-499d-8b86-123759aa6903 service nova] Creating event network-changed:8d7a682c-8735-4554-a952-dc548868e5d9 for instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 on hv-cinder-83735 Jun 16 17:27:51.494538 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-68180fa8-78d4-4cff-8e1d-666d43bb188d req-251923fb-ab8d-499d-8b86-123759aa6903 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051530 Jun 16 17:27:51.495237 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 314/624] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:52.037340 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-74d84cc7-2da7-4c93-9b76-c5b71be789e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:52.038052 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-74d84cc7-2da7-4c93-9b76-c5b71be789e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:52.045023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-74d84cc7-2da7-4c93-9b76-c5b71be789e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:52.045487 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-74d84cc7-2da7-4c93-9b76-c5b71be789e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:52.046249 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-74d84cc7-2da7-4c93-9b76-c5b71be789e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:52.046672 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-74d84cc7-2da7-4c93-9b76-c5b71be789e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:52.177507 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-bd9d38b5-1661-4778-820f-ad54a2cf3ba3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:52.178694 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-bd9d38b5-1661-4778-820f-ad54a2cf3ba3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:52.185817 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bd9d38b5-1661-4778-820f-ad54a2cf3ba3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:52.186263 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bd9d38b5-1661-4778-820f-ad54a2cf3ba3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:52.187005 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bd9d38b5-1661-4778-820f-ad54a2cf3ba3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:52.187204 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-74d84cc7-2da7-4c93-9b76-c5b71be789e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:52.187428 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bd9d38b5-1661-4778-820f-ad54a2cf3ba3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:52.196088 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-74d84cc7-2da7-4c93-9b76-c5b71be789e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:52.197622 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-74d84cc7-2da7-4c93-9b76-c5b71be789e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:52.198751 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-74d84cc7-2da7-4c93-9b76-c5b71be789e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1408 microversion: 2.20 time: 0.165507 Jun 16 17:27:52.199296 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 311/625] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:27:52 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:27:52.339828 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-bd9d38b5-1661-4778-820f-ad54a2cf3ba3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:52.347730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-bd9d38b5-1661-4778-820f-ad54a2cf3ba3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1673 microversion: 2.1 time: 0.175341 Jun 16 17:27:52.348381 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 315/626] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:52 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:52.376984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-740f7c02-e53b-4d3e-a576-3d4c6c225639 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:52.377501 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-740f7c02-e53b-4d3e-a576-3d4c6c225639 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:52.383984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-740f7c02-e53b-4d3e-a576-3d4c6c225639 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:52.384426 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-740f7c02-e53b-4d3e-a576-3d4c6c225639 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:52.385202 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-740f7c02-e53b-4d3e-a576-3d4c6c225639 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:52.385643 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-740f7c02-e53b-4d3e-a576-3d4c6c225639 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:52.471794 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.objects.instance [None req-740f7c02-e53b-4d3e-a576-3d4c6c225639 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lazy-loading 'services' on Instance uuid 4065d5c1-0b16-413a-a5b5-e0e725e1e71b {{(pid=117552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:27:52.556653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-740f7c02-e53b-4d3e-a576-3d4c6c225639 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/os-volume_attachments/c56cbab9-9648-4d55-8c9a-e973c96b8ea4" status: 202 len: 0 microversion: 2.1 time: 0.183858 Jun 16 17:27:52.557356 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 312/627] 10.222.0.66 () {58 vars in 1415 bytes} [Thu Jun 16 17:27:52 2022] DELETE /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/os-volume_attachments/c56cbab9-9648-4d55-8c9a-e973c96b8ea4 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:27:52.565844 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5c1369f6-0d5f-4cf1-b541-49e211f36501 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:52.566854 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5c1369f6-0d5f-4cf1-b541-49e211f36501 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:52.573066 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5c1369f6-0d5f-4cf1-b541-49e211f36501 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:52.573575 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5c1369f6-0d5f-4cf1-b541-49e211f36501 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:52.574330 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5c1369f6-0d5f-4cf1-b541-49e211f36501 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:52.574755 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5c1369f6-0d5f-4cf1-b541-49e211f36501 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:52.604852 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5c1369f6-0d5f-4cf1-b541-49e211f36501 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043150 Jun 16 17:27:52.605451 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 316/628] 10.222.0.66 () {58 vars in 1301 bytes} [Thu Jun 16 17:27:52 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:53.219868 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-6b7693e2-6b9b-4a96-a655-9fd9f42021a6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:53.220528 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-6b7693e2-6b9b-4a96-a655-9fd9f42021a6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:53.227794 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6b7693e2-6b9b-4a96-a655-9fd9f42021a6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:53.228240 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6b7693e2-6b9b-4a96-a655-9fd9f42021a6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:53.228987 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6b7693e2-6b9b-4a96-a655-9fd9f42021a6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:53.229469 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6b7693e2-6b9b-4a96-a655-9fd9f42021a6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:53.367493 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-6f7cd8f8-8cdc-47b8-871a-e2b1069f35e8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:53.367493 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-6f7cd8f8-8cdc-47b8-871a-e2b1069f35e8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:53.370792 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-6b7693e2-6b9b-4a96-a655-9fd9f42021a6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:53.374252 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6f7cd8f8-8cdc-47b8-871a-e2b1069f35e8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:53.374704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6f7cd8f8-8cdc-47b8-871a-e2b1069f35e8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:53.375462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6f7cd8f8-8cdc-47b8-871a-e2b1069f35e8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:53.375883 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6f7cd8f8-8cdc-47b8-871a-e2b1069f35e8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:53.379031 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-6b7693e2-6b9b-4a96-a655-9fd9f42021a6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:53.380506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-6b7693e2-6b9b-4a96-a655-9fd9f42021a6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:53.382269 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-6b7693e2-6b9b-4a96-a655-9fd9f42021a6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1408 microversion: 2.20 time: 0.167204 Jun 16 17:27:53.383186 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 313/629] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:27:53 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:53.596434 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6f7cd8f8-8cdc-47b8-871a-e2b1069f35e8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:53.606383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-6f7cd8f8-8cdc-47b8-871a-e2b1069f35e8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1673 microversion: 2.1 time: 0.243945 Jun 16 17:27:53.607093 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 317/630] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:53 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1673 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:53.622519 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-4d11a91e-11a9-4f28-a28f-f8922e294647 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:53.623627 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-4d11a91e-11a9-4f28-a28f-f8922e294647 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:53.631869 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4d11a91e-11a9-4f28-a28f-f8922e294647 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:53.632127 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4d11a91e-11a9-4f28-a28f-f8922e294647 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:53.632893 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4d11a91e-11a9-4f28-a28f-f8922e294647 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:53.633363 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4d11a91e-11a9-4f28-a28f-f8922e294647 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:53.665646 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-4d11a91e-11a9-4f28-a28f-f8922e294647 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047006 Jun 16 17:27:53.666434 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 314/631] 10.222.0.66 () {58 vars in 1301 bytes} [Thu Jun 16 17:27:53 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:54.400870 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-62fd0195-a41f-45b8-ab0f-2c9fb0f75b06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:54.401720 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-62fd0195-a41f-45b8-ab0f-2c9fb0f75b06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:54.409168 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-62fd0195-a41f-45b8-ab0f-2c9fb0f75b06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:54.409887 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-62fd0195-a41f-45b8-ab0f-2c9fb0f75b06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:54.410660 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-62fd0195-a41f-45b8-ab0f-2c9fb0f75b06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:54.411081 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-62fd0195-a41f-45b8-ab0f-2c9fb0f75b06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:54.573519 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-62fd0195-a41f-45b8-ab0f-2c9fb0f75b06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:54.581703 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-62fd0195-a41f-45b8-ab0f-2c9fb0f75b06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:54.583167 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-62fd0195-a41f-45b8-ab0f-2c9fb0f75b06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:54.584511 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-62fd0195-a41f-45b8-ab0f-2c9fb0f75b06 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1408 microversion: 2.20 time: 0.188197 Jun 16 17:27:54.585207 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 318/632] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:27:54 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:54.624473 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c198052a-6ef2-45a8-bd69-39d8129c11d3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:54.625189 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c198052a-6ef2-45a8-bd69-39d8129c11d3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:54.632377 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c198052a-6ef2-45a8-bd69-39d8129c11d3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:54.632824 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c198052a-6ef2-45a8-bd69-39d8129c11d3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:54.633625 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c198052a-6ef2-45a8-bd69-39d8129c11d3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:54.634080 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c198052a-6ef2-45a8-bd69-39d8129c11d3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:54.677509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2f17fd95-a73a-49d1-b42a-3ef27ed483c2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:54.679464 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2f17fd95-a73a-49d1-b42a-3ef27ed483c2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:54.687191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2f17fd95-a73a-49d1-b42a-3ef27ed483c2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:54.687641 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2f17fd95-a73a-49d1-b42a-3ef27ed483c2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:54.688448 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2f17fd95-a73a-49d1-b42a-3ef27ed483c2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:54.688880 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2f17fd95-a73a-49d1-b42a-3ef27ed483c2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:54.704397 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c198052a-6ef2-45a8-bd69-39d8129c11d3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:54.713501 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c198052a-6ef2-45a8-bd69-39d8129c11d3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1605 microversion: 2.1 time: 0.092771 Jun 16 17:27:54.721037 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2f17fd95-a73a-49d1-b42a-3ef27ed483c2 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047559 Jun 16 17:27:54.721704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 319/633] 10.222.0.66 () {58 vars in 1301 bytes} [Thu Jun 16 17:27:54 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:27:54.723185 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 315/634] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:54 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1605 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:54.793249 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-d961f5c8-c5e5-438c-80c5-4b9ab7acd6ab req-3abb8a54-42e8-47d0-8a48-511c7cd363b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d22b60d-19fe-4dca-8eef-821db5a4dc55", "name": "network-vif-deleted", "tag": "21fae4ca-fb3d-4b09-8071-928df2baff45"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:54.796612 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-6a348e3c-9977-40b3-9b02-5630cce31d13 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:54.797108 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-6a348e3c-9977-40b3-9b02-5630cce31d13 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:54.804480 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6a348e3c-9977-40b3-9b02-5630cce31d13 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:54.805032 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6a348e3c-9977-40b3-9b02-5630cce31d13 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:54.805873 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6a348e3c-9977-40b3-9b02-5630cce31d13 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:54.806309 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6a348e3c-9977-40b3-9b02-5630cce31d13 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:54.808089 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-d961f5c8-c5e5-438c-80c5-4b9ab7acd6ab req-3abb8a54-42e8-47d0-8a48-511c7cd363b7 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:54.808591 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-d961f5c8-c5e5-438c-80c5-4b9ab7acd6ab req-3abb8a54-42e8-47d0-8a48-511c7cd363b7 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:54.820708 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-d961f5c8-c5e5-438c-80c5-4b9ab7acd6ab req-3abb8a54-42e8-47d0-8a48-511c7cd363b7 service nova] Creating event network-vif-deleted:21fae4ca-fb3d-4b09-8071-928df2baff45 for instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 on hv-cinder-83735 Jun 16 17:27:54.826754 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-d961f5c8-c5e5-438c-80c5-4b9ab7acd6ab req-3abb8a54-42e8-47d0-8a48-511c7cd363b7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042441 Jun 16 17:27:54.827588 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 320/635] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:54.835399 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-6a348e3c-9977-40b3-9b02-5630cce31d13 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Going to try to terminate instance {{(pid=117552) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:27:54.925887 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-6a348e3c-9977-40b3-9b02-5630cce31d13 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 204 len: 0 microversion: 2.1 time: 0.132766 Jun 16 17:27:54.927049 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 316/636] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:27:54 2022] DELETE /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:27:54.936884 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-cd686a14-4d95-4140-83f1-cdea87c5debf tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:54.938217 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-cd686a14-4d95-4140-83f1-cdea87c5debf tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:54.946026 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cd686a14-4d95-4140-83f1-cdea87c5debf tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:54.946554 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cd686a14-4d95-4140-83f1-cdea87c5debf tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:54.947375 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cd686a14-4d95-4140-83f1-cdea87c5debf tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:54.947984 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cd686a14-4d95-4140-83f1-cdea87c5debf tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:55.119304 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-cd686a14-4d95-4140-83f1-cdea87c5debf tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:55.127458 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-cd686a14-4d95-4140-83f1-cdea87c5debf tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1688 microversion: 2.1 time: 0.195508 Jun 16 17:27:55.128132 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 321/637] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:54 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:55.604388 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9ad83fc1-f72c-4988-a2b0-047f9dba03e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:55.605380 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-9ad83fc1-f72c-4988-a2b0-047f9dba03e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:55.611934 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9ad83fc1-f72c-4988-a2b0-047f9dba03e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:55.612371 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9ad83fc1-f72c-4988-a2b0-047f9dba03e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:55.613142 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9ad83fc1-f72c-4988-a2b0-047f9dba03e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:55.613588 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9ad83fc1-f72c-4988-a2b0-047f9dba03e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:55.731372 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-63ad5fc3-21d9-46fd-973f-054a618d7606 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:55.732062 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-63ad5fc3-21d9-46fd-973f-054a618d7606 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:55.740066 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-63ad5fc3-21d9-46fd-973f-054a618d7606 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:55.740670 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-63ad5fc3-21d9-46fd-973f-054a618d7606 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:55.742481 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-63ad5fc3-21d9-46fd-973f-054a618d7606 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:55.742964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-63ad5fc3-21d9-46fd-973f-054a618d7606 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:55.760786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9ad83fc1-f72c-4988-a2b0-047f9dba03e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:55.769778 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9ad83fc1-f72c-4988-a2b0-047f9dba03e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:55.771412 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9ad83fc1-f72c-4988-a2b0-047f9dba03e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:55.773010 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9ad83fc1-f72c-4988-a2b0-047f9dba03e4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1408 microversion: 2.20 time: 0.173848 Jun 16 17:27:55.773644 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 317/638] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:27:55 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:55.813677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-63ad5fc3-21d9-46fd-973f-054a618d7606 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:55.822225 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-63ad5fc3-21d9-46fd-973f-054a618d7606 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1321 microversion: 2.1 time: 0.094949 Jun 16 17:27:55.822816 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 322/639] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:55 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1321 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:56.145631 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-6d2b124c-54af-42a8-9de5-25307f620f08 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:56.146139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-6d2b124c-54af-42a8-9de5-25307f620f08 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:56.153063 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6d2b124c-54af-42a8-9de5-25307f620f08 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:56.153538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6d2b124c-54af-42a8-9de5-25307f620f08 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:56.154295 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6d2b124c-54af-42a8-9de5-25307f620f08 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:56.154719 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6d2b124c-54af-42a8-9de5-25307f620f08 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:56.287674 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-6d2b124c-54af-42a8-9de5-25307f620f08 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:56.296107 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-6d2b124c-54af-42a8-9de5-25307f620f08 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1688 microversion: 2.1 time: 0.154515 Jun 16 17:27:56.296684 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 318/640] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:56 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:56.791687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-0059cbc7-f8c2-49f3-94a1-d34614da0d6f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:56.792276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-0059cbc7-f8c2-49f3-94a1-d34614da0d6f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:56.799243 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0059cbc7-f8c2-49f3-94a1-d34614da0d6f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:56.799680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0059cbc7-f8c2-49f3-94a1-d34614da0d6f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:56.800469 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0059cbc7-f8c2-49f3-94a1-d34614da0d6f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:56.801021 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0059cbc7-f8c2-49f3-94a1-d34614da0d6f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:56.839850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0fd76e04-154c-4731-a7a3-c8a895a7ffc8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:56.840857 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0fd76e04-154c-4731-a7a3-c8a895a7ffc8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:56.849534 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0fd76e04-154c-4731-a7a3-c8a895a7ffc8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:56.850190 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0fd76e04-154c-4731-a7a3-c8a895a7ffc8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:56.851385 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0fd76e04-154c-4731-a7a3-c8a895a7ffc8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:56.852007 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0fd76e04-154c-4731-a7a3-c8a895a7ffc8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:56.924500 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0fd76e04-154c-4731-a7a3-c8a895a7ffc8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:56.933034 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0fd76e04-154c-4731-a7a3-c8a895a7ffc8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1321 microversion: 2.1 time: 0.097085 Jun 16 17:27:56.933648 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 319/641] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:56 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1321 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:56.950992 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0059cbc7-f8c2-49f3-94a1-d34614da0d6f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:56.959470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0059cbc7-f8c2-49f3-94a1-d34614da0d6f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:56.960956 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0059cbc7-f8c2-49f3-94a1-d34614da0d6f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:56.962104 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-0059cbc7-f8c2-49f3-94a1-d34614da0d6f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1408 microversion: 2.20 time: 0.174855 Jun 16 17:27:56.962646 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 323/642] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:27:56 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:57.313447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c84930b0-6d3e-427d-8be0-9256a909a978 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:57.314051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c84930b0-6d3e-427d-8be0-9256a909a978 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:57.320845 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c84930b0-6d3e-427d-8be0-9256a909a978 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:57.321332 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c84930b0-6d3e-427d-8be0-9256a909a978 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:57.322096 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c84930b0-6d3e-427d-8be0-9256a909a978 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:57.322528 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c84930b0-6d3e-427d-8be0-9256a909a978 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:57.461089 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c84930b0-6d3e-427d-8be0-9256a909a978 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:57.470287 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c84930b0-6d3e-427d-8be0-9256a909a978 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1688 microversion: 2.1 time: 0.160480 Jun 16 17:27:57.470817 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 320/643] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:57 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:57.950742 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-1da02c62-a905-4f43-af80-7909ae764b05 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:57.951376 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-1da02c62-a905-4f43-af80-7909ae764b05 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:57.958439 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1da02c62-a905-4f43-af80-7909ae764b05 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:57.958882 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1da02c62-a905-4f43-af80-7909ae764b05 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:57.959866 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1da02c62-a905-4f43-af80-7909ae764b05 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:57.960350 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1da02c62-a905-4f43-af80-7909ae764b05 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:57.980285 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-2653a9d4-7481-457e-811a-6cdafabc6873 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:57.980852 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-2653a9d4-7481-457e-811a-6cdafabc6873 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:57.987962 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2653a9d4-7481-457e-811a-6cdafabc6873 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:57.988407 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2653a9d4-7481-457e-811a-6cdafabc6873 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:57.989169 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2653a9d4-7481-457e-811a-6cdafabc6873 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:57.989621 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2653a9d4-7481-457e-811a-6cdafabc6873 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:58.025743 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-1da02c62-a905-4f43-af80-7909ae764b05 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:58.034372 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-1da02c62-a905-4f43-af80-7909ae764b05 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 200 len: 1321 microversion: 2.1 time: 0.087413 Jun 16 17:27:58.034927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 324/644] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:57 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 1321 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:58.131573 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2653a9d4-7481-457e-811a-6cdafabc6873 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:58.140254 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2653a9d4-7481-457e-811a-6cdafabc6873 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:58.141772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2653a9d4-7481-457e-811a-6cdafabc6873 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:58.142880 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-2653a9d4-7481-457e-811a-6cdafabc6873 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1408 microversion: 2.20 time: 0.166833 Jun 16 17:27:58.143436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 321/645] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:27:57 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:58.489665 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-83b555eb-2300-4561-89e4-2131becb530e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:58.491533 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-83b555eb-2300-4561-89e4-2131becb530e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:58.493640 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-3026b287-14f4-486d-bb96-ee1a6989bd8e req-d4b28ada-d2cf-4ffd-ba5b-8d6a34d3d19c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4", "name": "network-vif-plugged", "status": "completed", "tag": "8d7a682c-8735-4554-a952-dc548868e5d9"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:58.494808 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:58.495787 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=6 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:58.502485 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-83b555eb-2300-4561-89e4-2131becb530e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:58.503390 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-83b555eb-2300-4561-89e4-2131becb530e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:58.504542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-83b555eb-2300-4561-89e4-2131becb530e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:58.504633 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-83b555eb-2300-4561-89e4-2131becb530e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:58.522597 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-3026b287-14f4-486d-bb96-ee1a6989bd8e req-d4b28ada-d2cf-4ffd-ba5b-8d6a34d3d19c service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:58.523066 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-3026b287-14f4-486d-bb96-ee1a6989bd8e req-d4b28ada-d2cf-4ffd-ba5b-8d6a34d3d19c service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:58.559543 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-3026b287-14f4-486d-bb96-ee1a6989bd8e req-d4b28ada-d2cf-4ffd-ba5b-8d6a34d3d19c service nova] Creating event network-vif-plugged:8d7a682c-8735-4554-a952-dc548868e5d9 for instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 on hv-cinder-83735 Jun 16 17:27:58.570256 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-3026b287-14f4-486d-bb96-ee1a6989bd8e req-d4b28ada-d2cf-4ffd-ba5b-8d6a34d3d19c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081672 Jun 16 17:27:58.570256 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 322/646] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:58.708474 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-83b555eb-2300-4561-89e4-2131becb530e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:58.717845 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-83b555eb-2300-4561-89e4-2131becb530e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1688 microversion: 2.1 time: 0.233078 Jun 16 17:27:58.718746 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 325/647] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:58 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1688 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:59.052394 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d21636e9-00bb-47f6-a41d-60c34c3d7a84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:59.054393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d21636e9-00bb-47f6-a41d-60c34c3d7a84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:59.056435 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=6 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:59.063061 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d21636e9-00bb-47f6-a41d-60c34c3d7a84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:59.063511 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d21636e9-00bb-47f6-a41d-60c34c3d7a84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:59.064467 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d21636e9-00bb-47f6-a41d-60c34c3d7a84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:59.064903 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d21636e9-00bb-47f6-a41d-60c34c3d7a84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:59.079779 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-d21636e9-00bb-47f6-a41d-60c34c3d7a84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] HTTP exception thrown: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d21636e9-00bb-47f6-a41d-60c34c3d7a84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Request method failure captured: Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 HTTP/1.1 Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2beuWk7EZlEjA9yRMTDbNejBZxpiStz8muB1t5YfyUNjOp366FElg-CGG7YxZd-LPYYcDXJpDnt37xIZKURu01Wg9u2dzkYnziyBT6e1zA88cgUmblIzeM6q8-Ibj73wyofaPbdJ0KQJkVcnySSy9zuDYNkRjPIMYbkXjjXewjdmZU Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: f029a8bb389c4d348c0e9001c5fa059c Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:27:59.081497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:27:59.082874 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f029a8bb389c4d348c0e9001c5fa059c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f029a8bb389c4d348c0e9001c5fa059c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f029a8bb389c4d348c0e9001c5fa059c", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f029a8bb389c4d348c0e9001c5fa059c"}]}] Jun 16 17:27:59.082874 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:27:59.082874 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: f029a8bb389c4d348c0e9001c5fa059c Jun 16 17:27:59.082874 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:27:59.082874 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-AttachVolumeTestJSON-336390128-project Jun 16 17:27:59.082874 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:27:59.082874 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:27:59.082874 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 1a3418bd5d7f430ca84efd5c83e38fed Jun 16 17:27:59.082874 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-AttachVolumeTestJSON-336390128-project Jun 16 17:27:59.082874 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:27:59.082874 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. Jun 16 17:27:59.082874 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': '7d22b60d-19fe-4dca-8eef-821db5a4dc55'} Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:27:59.083956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. Jun 16 17:27:59.085529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:27:59.087317 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d21636e9-00bb-47f6-a41d-60c34c3d7a84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Returning 404 to user: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:27:59.087317 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d21636e9-00bb-47f6-a41d-60c34c3d7a84 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 404 len: 111 microversion: 2.1 time: 0.035532 Jun 16 17:27:59.087317 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 323/648] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:59 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:27:59.091970 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2ba3685b-760d-443f-9da0-6fa3b51a513f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '.version_select at 0x7f66b14e2dc0>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:59.111241 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2ba3685b-760d-443f-9da0-6fa3b51a513f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-969411101" status: 202 len: 0 microversion: 2.1 time: 0.023019 Jun 16 17:27:59.111825 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 326/649] 10.222.0.66 () {58 vars in 1217 bytes} [Thu Jun 16 17:27:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-969411101 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:27:59.163095 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-01ee7586-1b1e-4f0c-9d44-8addb02ac351 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:59.164907 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-01ee7586-1b1e-4f0c-9d44-8addb02ac351 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:59.175398 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-01ee7586-1b1e-4f0c-9d44-8addb02ac351 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:59.175398 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-01ee7586-1b1e-4f0c-9d44-8addb02ac351 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:59.176020 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-01ee7586-1b1e-4f0c-9d44-8addb02ac351 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:59.176452 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-01ee7586-1b1e-4f0c-9d44-8addb02ac351 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:59.202205 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:59.381301 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-01ee7586-1b1e-4f0c-9d44-8addb02ac351 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:59.390097 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-01ee7586-1b1e-4f0c-9d44-8addb02ac351 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:59.391586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-01ee7586-1b1e-4f0c-9d44-8addb02ac351 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:59.392890 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-01ee7586-1b1e-4f0c-9d44-8addb02ac351 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1408 microversion: 2.20 time: 0.234619 Jun 16 17:27:59.393500 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 324/650] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:27:59 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:59.561143 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-d6d06a93-0d9f-45dd-b237-253e4d3d632b req-0d63e6da-5f1a-4f44-a8d0-6a123d9d67bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4065d5c1-0b16-413a-a5b5-e0e725e1e71b", "name": "network-vif-deleted", "tag": "3e68f997-7180-47a9-a1f0-ae3a5f70d0a3"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:59.564877 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:59.586450 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-d6d06a93-0d9f-45dd-b237-253e4d3d632b req-0d63e6da-5f1a-4f44-a8d0-6a123d9d67bf service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:59.586894 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-d6d06a93-0d9f-45dd-b237-253e4d3d632b req-0d63e6da-5f1a-4f44-a8d0-6a123d9d67bf service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:59.601124 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-d6d06a93-0d9f-45dd-b237-253e4d3d632b req-0d63e6da-5f1a-4f44-a8d0-6a123d9d67bf service nova] Creating event network-vif-deleted:3e68f997-7180-47a9-a1f0-ae3a5f70d0a3 for instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b on hv-cinder-83735 Jun 16 17:27:59.606982 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-d6d06a93-0d9f-45dd-b237-253e4d3d632b req-0d63e6da-5f1a-4f44-a8d0-6a123d9d67bf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050154 Jun 16 17:27:59.608191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 327/651] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:59.736192 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-2afef4fc-9c0b-4fac-9dd8-13f87789f3bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:59.737089 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-2afef4fc-9c0b-4fac-9dd8-13f87789f3bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:27:59.739055 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:59.746778 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2afef4fc-9c0b-4fac-9dd8-13f87789f3bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:59.747499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2afef4fc-9c0b-4fac-9dd8-13f87789f3bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:59.750896 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2afef4fc-9c0b-4fac-9dd8-13f87789f3bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:27:59.751690 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2afef4fc-9c0b-4fac-9dd8-13f87789f3bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:27:59.841295 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2afef4fc-9c0b-4fac-9dd8-13f87789f3bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:27:59.858362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-2afef4fc-9c0b-4fac-9dd8-13f87789f3bb tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 200 len: 1328 microversion: 2.1 time: 0.124837 Jun 16 17:27:59.859550 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 325/652] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:27:59 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 1328 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:59.861731 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-283d6caa-4806-4e76-b9ad-061687252df5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Action: 'create', calling method: .version_select at 0x7f66b15d71f0>, body: {"keypair": {"name": "tempest-keypair-1705009479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPU6EqxLgmttKpEhUwTirMl1zZeIocjHNQnXiyMeoRswpurL/ZkoK+Oum0LbXAm6n7RW7PFhT/ne8SLeWLdi8k4OP621Kx/NKUmMaJB2CRQO4QJw+YAPjFIeAMQ0W5d0Jw=="}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:59.882403 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-283d6caa-4806-4e76-b9ad-061687252df5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Getting quotas for project f029a8bb389c4d348c0e9001c5fa059c. Resources: {'key_pairs'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:27:59.886723 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-283d6caa-4806-4e76-b9ad-061687252df5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Getting quotas for user 1a3418bd5d7f430ca84efd5c83e38fed and project f029a8bb389c4d348c0e9001c5fa059c. Resources: {'key_pairs'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:27:59.911271 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-283d6caa-4806-4e76-b9ad-061687252df5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054563 Jun 16 17:27:59.911981 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 328/653] 10.222.0.66 () {60 vars in 1158 bytes} [Thu Jun 16 17:27:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:28:00.411822 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-6659bd1b-7af4-4e32-b2de-5331f9a38e92 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:00.412590 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-6659bd1b-7af4-4e32-b2de-5331f9a38e92 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:00.420152 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6659bd1b-7af4-4e32-b2de-5331f9a38e92 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:00.420596 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6659bd1b-7af4-4e32-b2de-5331f9a38e92 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:00.421396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6659bd1b-7af4-4e32-b2de-5331f9a38e92 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:00.422007 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6659bd1b-7af4-4e32-b2de-5331f9a38e92 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:00.657019 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-6659bd1b-7af4-4e32-b2de-5331f9a38e92 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:00.666511 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-6659bd1b-7af4-4e32-b2de-5331f9a38e92 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:00.668139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-6659bd1b-7af4-4e32-b2de-5331f9a38e92 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:00.669615 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-6659bd1b-7af4-4e32-b2de-5331f9a38e92 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1599 microversion: 2.20 time: 0.261637 Jun 16 17:28:00.670254 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 326/654] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:28:00 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1599 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:28:00.688859 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c95f884d-a01f-485d-a30c-8f7fc80aa77c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:00.689977 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c95f884d-a01f-485d-a30c-8f7fc80aa77c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:00.708565 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c95f884d-a01f-485d-a30c-8f7fc80aa77c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:00.708992 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c95f884d-a01f-485d-a30c-8f7fc80aa77c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:00.710770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c95f884d-a01f-485d-a30c-8f7fc80aa77c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:00.711206 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c95f884d-a01f-485d-a30c-8f7fc80aa77c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:00.803746 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c95f884d-a01f-485d-a30c-8f7fc80aa77c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.118832 Jun 16 17:28:00.804458 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 329/655] 10.222.0.66 () {60 vars in 1315 bytes} [Thu Jun 16 17:28:00 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:28:00.877155 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f3a8e8a5-d901-4123-9748-24e98c336c77 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:00.878125 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f3a8e8a5-d901-4123-9748-24e98c336c77 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 4065d5c1-0b16-413a-a5b5-e0e725e1e71b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:00.886097 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f3a8e8a5-d901-4123-9748-24e98c336c77 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:00.886626 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f3a8e8a5-d901-4123-9748-24e98c336c77 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:00.887465 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f3a8e8a5-d901-4123-9748-24e98c336c77 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:00.888118 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f3a8e8a5-d901-4123-9748-24e98c336c77 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:00.907310 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-f3a8e8a5-d901-4123-9748-24e98c336c77 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] HTTP exception thrown: Instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b could not be found. Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f3a8e8a5-d901-4123-9748-24e98c336c77 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Request method failure captured: Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b HTTP/1.1 Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2baiTAiiIqvs05AAgXEGNrzgTOS0KD51O8IrwALK_82kaIh4oIhGWJGUbDxg3s9UADdVPKzO_ZDdu65W2o4SzEeVM38vngvZj4zT9_ojpKoesbQIclVOSFNU9SjyczrwaH1BGy99G4f7f3jUdIV6_zsnlingiczP1owxkwlv_alFaA Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: ccf5c45783454fc5a7872490196f07e0 Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1475515620 Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:28:00.908302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:28:00.909970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ccf5c45783454fc5a7872490196f07e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ccf5c45783454fc5a7872490196f07e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ccf5c45783454fc5a7872490196f07e0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ccf5c45783454fc5a7872490196f07e0"}]}] Jun 16 17:28:00.909970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1475515620 Jun 16 17:28:00.909970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: ccf5c45783454fc5a7872490196f07e0 Jun 16 17:28:00.909970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1475515620 Jun 16 17:28:00.909970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-ServerRescueNegativeTestJSON-1475515620-project Jun 16 17:28:00.909970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:28:00.909970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:28:00.909970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 0cd8a309f6914d83b8e72bc60a5d7924 Jun 16 17:28:00.909970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1475515620-project Jun 16 17:28:00.909970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:28:00.909970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b could not be found. Jun 16 17:28:00.909970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': '4065d5c1-0b16-413a-a5b5-e0e725e1e71b'} Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b could not be found. Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:28:00.915265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b could not be found. Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b could not be found. Jun 16 17:28:00.917099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:00.918601 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f3a8e8a5-d901-4123-9748-24e98c336c77 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Returning 404 to user: Instance 4065d5c1-0b16-413a-a5b5-e0e725e1e71b could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:28:00.918601 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f3a8e8a5-d901-4123-9748-24e98c336c77 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b" status: 404 len: 111 microversion: 2.1 time: 0.037091 Jun 16 17:28:00.918601 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 327/656] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:00 2022] GET /compute/v2.1/servers/4065d5c1-0b16-413a-a5b5-e0e725e1e71b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:28:00.920236 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4572201f-2eda-40d5-aa92-9191e7f7675c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '.version_select at 0x7f66b1531dc0>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:00.939738 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4572201f-2eda-40d5-aa92-9191e7f7675c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-255563373" status: 202 len: 0 microversion: 2.1 time: 0.024749 Jun 16 17:28:00.940399 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 330/657] 10.222.0.66 () {58 vars in 1217 bytes} [Thu Jun 16 17:28:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-255563373 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:28:02.291300 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5f2f7d27-ad15-440a-9feb-40ac8f60ee50 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1325891063", "imageRef": "c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82c6c893-96f4-45ae-b1e3-d70ff1db738d"}], "security_groups": [{"name": "tempest-securitygroup--1290764775"}], "key_name": "tempest-keypair-1705009479", "user_data": "}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:28:02.456702 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.network.neutron [None req-5f2f7d27-ad15-440a-9feb-40ac8f60ee50 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] validate_networks() for [('82c6c893-96f4-45ae-b1e3-d70ff1db738d', None, None, None, None, None)] {{(pid=117552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:28:02.578675 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-aa16ac8d-fc4e-44dc-bf6d-21b4f86a9e2c req-e8beda9a-eb05-4400-9391-8aa87d797ddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4", "tag": "8d7a682c-8735-4554-a952-dc548868e5d9"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:28:02.588525 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-aa16ac8d-fc4e-44dc-bf6d-21b4f86a9e2c req-e8beda9a-eb05-4400-9391-8aa87d797ddf service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:02.589377 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-aa16ac8d-fc4e-44dc-bf6d-21b4f86a9e2c req-e8beda9a-eb05-4400-9391-8aa87d797ddf service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:02.602333 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-aa16ac8d-fc4e-44dc-bf6d-21b4f86a9e2c req-e8beda9a-eb05-4400-9391-8aa87d797ddf service nova] Creating event network-changed:8d7a682c-8735-4554-a952-dc548868e5d9 for instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 on hv-cinder-83735 Jun 16 17:28:02.607680 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-aa16ac8d-fc4e-44dc-bf6d-21b4f86a9e2c req-e8beda9a-eb05-4400-9391-8aa87d797ddf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033236 Jun 16 17:28:02.608567 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 331/658] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:28:03.194576 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-5f2f7d27-ad15-440a-9feb-40ac8f60ee50 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Flavor limits 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:28:03.195535 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-5f2f7d27-ad15-440a-9feb-40ac8f60ee50 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Image limits 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:28:03.196370 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-5f2f7d27-ad15-440a-9feb-40ac8f60ee50 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Flavor pref 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:28:03.196949 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-5f2f7d27-ad15-440a-9feb-40ac8f60ee50 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Image pref 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:28:03.197564 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-5f2f7d27-ad15-440a-9feb-40ac8f60ee50 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:28:03.209072 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5f2f7d27-ad15-440a-9feb-40ac8f60ee50 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:03.210277 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5f2f7d27-ad15-440a-9feb-40ac8f60ee50 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:03.211404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5f2f7d27-ad15-440a-9feb-40ac8f60ee50 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:03.212072 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5f2f7d27-ad15-440a-9feb-40ac8f60ee50 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:03.233483 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-5f2f7d27-ad15-440a-9feb-40ac8f60ee50 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Getting quotas for project f029a8bb389c4d348c0e9001c5fa059c. Resources: {'cores', 'instances', 'ram'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:28:03.239541 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-5f2f7d27-ad15-440a-9feb-40ac8f60ee50 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Getting quotas for user 1a3418bd5d7f430ca84efd5c83e38fed and project f029a8bb389c4d348c0e9001c5fa059c. Resources: {'cores', 'instances', 'ram'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:28:03.265880 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-5f2f7d27-ad15-440a-9feb-40ac8f60ee50 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Going to run 1 instances... {{(pid=117552) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:28:03.268379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-5f2f7d27-ad15-440a-9feb-40ac8f60ee50 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:28:03.322889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-5f2f7d27-ad15-440a-9feb-40ac8f60ee50 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.036021 Jun 16 17:28:03.323541 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 328/659] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:28:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:28:03.336625 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-182ec829-3c85-4510-93a8-a81fe0d2ccb3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:03.337762 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-182ec829-3c85-4510-93a8-a81fe0d2ccb3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:03.417280 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-182ec829-3c85-4510-93a8-a81fe0d2ccb3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:03.424742 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-182ec829-3c85-4510-93a8-a81fe0d2ccb3 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1238 microversion: 2.1 time: 0.094241 Jun 16 17:28:03.433601 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 332/660] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:03 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1238 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:03.937510 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-23f644f3-364c-497b-bce3-69a4abee6400 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:03.938020 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-23f644f3-364c-497b-bce3-69a4abee6400 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:03.945326 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-23f644f3-364c-497b-bce3-69a4abee6400 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:03.945810 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-23f644f3-364c-497b-bce3-69a4abee6400 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:03.946664 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-23f644f3-364c-497b-bce3-69a4abee6400 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:03.947109 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-23f644f3-364c-497b-bce3-69a4abee6400 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:03.976695 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-23f644f3-364c-497b-bce3-69a4abee6400 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Going to try to terminate instance {{(pid=117552) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:28:04.064032 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-23f644f3-364c-497b-bce3-69a4abee6400 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "DELETE /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 204 len: 0 microversion: 2.1 time: 0.130189 Jun 16 17:28:04.064482 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 329/661] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:28:03 2022] DELETE /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:28:04.073926 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-66008313-e4ba-4415-a92a-bc030df1680a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:04.074528 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-66008313-e4ba-4415-a92a-bc030df1680a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:04.083101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-66008313-e4ba-4415-a92a-bc030df1680a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:04.083553 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-66008313-e4ba-4415-a92a-bc030df1680a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:04.084606 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-66008313-e4ba-4415-a92a-bc030df1680a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:04.085064 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-66008313-e4ba-4415-a92a-bc030df1680a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:04.233655 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-66008313-e4ba-4415-a92a-bc030df1680a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:04.242914 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-66008313-e4ba-4415-a92a-bc030df1680a tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1507 microversion: 2.1 time: 0.173302 Jun 16 17:28:04.243489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 333/662] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:04 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:04.443456 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-546dab3e-5a36-4444-bffd-1b7bbb335136 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:04.444193 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-546dab3e-5a36-4444-bffd-1b7bbb335136 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:04.451249 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-546dab3e-5a36-4444-bffd-1b7bbb335136 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:04.451692 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-546dab3e-5a36-4444-bffd-1b7bbb335136 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:04.452466 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-546dab3e-5a36-4444-bffd-1b7bbb335136 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:04.452879 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-546dab3e-5a36-4444-bffd-1b7bbb335136 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:04.520803 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-546dab3e-5a36-4444-bffd-1b7bbb335136 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:04.532430 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-546dab3e-5a36-4444-bffd-1b7bbb335136 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1290 microversion: 2.1 time: 0.092898 Jun 16 17:28:04.533622 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 330/663] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:04 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:05.261527 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-0f9e1224-b4e2-4189-aa68-bfee31463bc3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:05.262133 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-0f9e1224-b4e2-4189-aa68-bfee31463bc3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:05.268947 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0f9e1224-b4e2-4189-aa68-bfee31463bc3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:05.269433 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0f9e1224-b4e2-4189-aa68-bfee31463bc3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:05.270319 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0f9e1224-b4e2-4189-aa68-bfee31463bc3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:05.270759 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0f9e1224-b4e2-4189-aa68-bfee31463bc3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:05.290416 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=100 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:05.419609 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0f9e1224-b4e2-4189-aa68-bfee31463bc3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:05.432450 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-0f9e1224-b4e2-4189-aa68-bfee31463bc3 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1507 microversion: 2.1 time: 0.175046 Jun 16 17:28:05.433111 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 334/664] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:05 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:05.551159 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-103e6d73-9a69-4d07-b2f3-00235a11e9d6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:05.551795 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-103e6d73-9a69-4d07-b2f3-00235a11e9d6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:05.559903 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-103e6d73-9a69-4d07-b2f3-00235a11e9d6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:05.560402 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-103e6d73-9a69-4d07-b2f3-00235a11e9d6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:05.561255 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-103e6d73-9a69-4d07-b2f3-00235a11e9d6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:05.561759 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-103e6d73-9a69-4d07-b2f3-00235a11e9d6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:05.633705 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-103e6d73-9a69-4d07-b2f3-00235a11e9d6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:05.645566 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-103e6d73-9a69-4d07-b2f3-00235a11e9d6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1290 microversion: 2.1 time: 0.099370 Jun 16 17:28:05.646300 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 331/665] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:05 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1290 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:06.453010 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-999ca2b1-7273-4247-8d1e-872f4743dd83 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:06.453656 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-999ca2b1-7273-4247-8d1e-872f4743dd83 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:06.461892 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-999ca2b1-7273-4247-8d1e-872f4743dd83 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:06.462335 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-999ca2b1-7273-4247-8d1e-872f4743dd83 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:06.463433 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-999ca2b1-7273-4247-8d1e-872f4743dd83 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:06.463877 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-999ca2b1-7273-4247-8d1e-872f4743dd83 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:06.632900 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-999ca2b1-7273-4247-8d1e-872f4743dd83 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:06.646548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-999ca2b1-7273-4247-8d1e-872f4743dd83 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1507 microversion: 2.1 time: 0.197663 Jun 16 17:28:06.647700 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 335/666] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:06 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:06.667556 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c9b6a604-896f-4cdd-b4e9-120568b02e0a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:06.669307 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c9b6a604-896f-4cdd-b4e9-120568b02e0a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:06.684014 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c9b6a604-896f-4cdd-b4e9-120568b02e0a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:06.684715 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c9b6a604-896f-4cdd-b4e9-120568b02e0a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:06.687703 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c9b6a604-896f-4cdd-b4e9-120568b02e0a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:06.688820 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c9b6a604-896f-4cdd-b4e9-120568b02e0a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:06.782467 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c9b6a604-896f-4cdd-b4e9-120568b02e0a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:06.791960 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c9b6a604-896f-4cdd-b4e9-120568b02e0a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1298 microversion: 2.1 time: 0.132540 Jun 16 17:28:06.792539 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 332/667] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:06 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1298 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:07.533513 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-551af57a-0ee3-47dc-a0d3-6e2620e757c5 req-5be15224-3bf1-4f4e-95e1-f4e3165507cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75957299-3d36-4f9c-a081-9e621c88225c", "name": "network-vif-deleted", "tag": "24585d4c-eda6-469f-a310-d2d5f70274a1"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:28:07.543877 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-551af57a-0ee3-47dc-a0d3-6e2620e757c5 req-5be15224-3bf1-4f4e-95e1-f4e3165507cd service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:07.544315 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-551af57a-0ee3-47dc-a0d3-6e2620e757c5 req-5be15224-3bf1-4f4e-95e1-f4e3165507cd service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:07.556696 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-551af57a-0ee3-47dc-a0d3-6e2620e757c5 req-5be15224-3bf1-4f4e-95e1-f4e3165507cd service nova] Creating event network-vif-deleted:24585d4c-eda6-469f-a310-d2d5f70274a1 for instance 75957299-3d36-4f9c-a081-9e621c88225c on hv-cinder-83735 Jun 16 17:28:07.563310 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-551af57a-0ee3-47dc-a0d3-6e2620e757c5 req-5be15224-3bf1-4f4e-95e1-f4e3165507cd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243060 Jun 16 17:28:07.563923 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 336/668] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:28:07.675429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-38e5e6c4-dd26-4b38-88fc-4cab1f6fe033 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:07.676044 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-38e5e6c4-dd26-4b38-88fc-4cab1f6fe033 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:07.684642 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-38e5e6c4-dd26-4b38-88fc-4cab1f6fe033 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:07.685092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-38e5e6c4-dd26-4b38-88fc-4cab1f6fe033 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:07.691541 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-38e5e6c4-dd26-4b38-88fc-4cab1f6fe033 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:07.692138 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-38e5e6c4-dd26-4b38-88fc-4cab1f6fe033 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:07.738854 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-38e5e6c4-dd26-4b38-88fc-4cab1f6fe033 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:07.739699 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-38e5e6c4-dd26-4b38-88fc-4cab1f6fe033 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:07.740203 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.objects.instance [None req-38e5e6c4-dd26-4b38-88fc-4cab1f6fe033 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lazy-loading 'fault' on Instance uuid 75957299-3d36-4f9c-a081-9e621c88225c {{(pid=117552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:28:07.798097 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-38e5e6c4-dd26-4b38-88fc-4cab1f6fe033 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:07.814030 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d44662ff-4892-4109-bfd2-475489db6d7f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:07.815026 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-d44662ff-4892-4109-bfd2-475489db6d7f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:07.821854 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-38e5e6c4-dd26-4b38-88fc-4cab1f6fe033 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 200 len: 1310 microversion: 2.1 time: 0.151255 Jun 16 17:28:07.833694 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 333/669] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:07 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 1310 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:07.842272 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d44662ff-4892-4109-bfd2-475489db6d7f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:07.843307 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d44662ff-4892-4109-bfd2-475489db6d7f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:07.844841 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d44662ff-4892-4109-bfd2-475489db6d7f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:07.845618 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d44662ff-4892-4109-bfd2-475489db6d7f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:08.041861 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d44662ff-4892-4109-bfd2-475489db6d7f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:08.053032 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-d44662ff-4892-4109-bfd2-475489db6d7f tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1364 microversion: 2.1 time: 0.245324 Jun 16 17:28:08.054131 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 337/670] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:07 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:08.688455 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-302636bd-780f-4749-a3d3-621fe2c19c04 req-f1641e1b-cf93-40cb-8642-a444b4293c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeb07519-2ce6-44ee-a88c-d46b4e11b367", "tag": "7176d454-867c-4dc6-b412-5623b5292926"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:28:08.698043 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-302636bd-780f-4749-a3d3-621fe2c19c04 req-f1641e1b-cf93-40cb-8642-a444b4293c5d service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:08.698481 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-302636bd-780f-4749-a3d3-621fe2c19c04 req-f1641e1b-cf93-40cb-8642-a444b4293c5d service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:08.715261 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-302636bd-780f-4749-a3d3-621fe2c19c04 req-f1641e1b-cf93-40cb-8642-a444b4293c5d service nova] Creating event network-changed:7176d454-867c-4dc6-b412-5623b5292926 for instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 on hv-cinder-83735 Jun 16 17:28:08.721137 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-302636bd-780f-4749-a3d3-621fe2c19c04 req-f1641e1b-cf93-40cb-8642-a444b4293c5d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149172 Jun 16 17:28:08.721932 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 334/671] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:28:08.845765 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-cced9983-a048-4a5f-b957-102e50dae2be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:08.846627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-cced9983-a048-4a5f-b957-102e50dae2be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 75957299-3d36-4f9c-a081-9e621c88225c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:08.854748 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cced9983-a048-4a5f-b957-102e50dae2be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:08.855191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cced9983-a048-4a5f-b957-102e50dae2be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:08.858698 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cced9983-a048-4a5f-b957-102e50dae2be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:08.859176 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cced9983-a048-4a5f-b957-102e50dae2be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:08.878896 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-cced9983-a048-4a5f-b957-102e50dae2be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] HTTP exception thrown: Instance 75957299-3d36-4f9c-a081-9e621c88225c could not be found. Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-cced9983-a048-4a5f-b957-102e50dae2be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Request method failure captured: Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c HTTP/1.1 Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2baiTAiiIqvs05AAgXEGNrzgTOS0KD51O8IrwALK_82kaIh4oIhGWJGUbDxg3s9UADdVPKzO_ZDdu65W2o4SzEeVM38vngvZj4zT9_ojpKoesbQIclVOSFNU9SjyczrwaH1BGy99G4f7f3jUdIV6_zsnlingiczP1owxkwlv_alFaA Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: ccf5c45783454fc5a7872490196f07e0 Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1475515620 Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:28:08.880548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:28:08.884470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ccf5c45783454fc5a7872490196f07e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ccf5c45783454fc5a7872490196f07e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ccf5c45783454fc5a7872490196f07e0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ccf5c45783454fc5a7872490196f07e0"}]}] Jun 16 17:28:08.884470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1475515620 Jun 16 17:28:08.884470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: ccf5c45783454fc5a7872490196f07e0 Jun 16 17:28:08.884470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1475515620 Jun 16 17:28:08.884470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-ServerRescueNegativeTestJSON-1475515620-project Jun 16 17:28:08.884470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:28:08.884470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:28:08.884470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: 0cd8a309f6914d83b8e72bc60a5d7924 Jun 16 17:28:08.884470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1475515620-project Jun 16 17:28:08.884470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:28:08.884470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance 75957299-3d36-4f9c-a081-9e621c88225c could not be found. Jun 16 17:28:08.884470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': '75957299-3d36-4f9c-a081-9e621c88225c'} Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75957299-3d36-4f9c-a081-9e621c88225c could not be found. Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:28:08.885730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75957299-3d36-4f9c-a081-9e621c88225c could not be found. Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75957299-3d36-4f9c-a081-9e621c88225c could not be found. Jun 16 17:28:08.887783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:28:08.889349 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-cced9983-a048-4a5f-b957-102e50dae2be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Returning 404 to user: Instance 75957299-3d36-4f9c-a081-9e621c88225c could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:28:08.889349 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-cced9983-a048-4a5f-b957-102e50dae2be tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c" status: 404 len: 111 microversion: 2.1 time: 0.044067 Jun 16 17:28:08.889349 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 338/672] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:08 2022] GET /compute/v2.1/servers/75957299-3d36-4f9c-a081-9e621c88225c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:28:08.894292 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e2217f1e-4ddd-4372-a081-8cfce233d06d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:08.894886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e2217f1e-4ddd-4372-a081-8cfce233d06d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:08.901866 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e2217f1e-4ddd-4372-a081-8cfce233d06d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:08.902462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e2217f1e-4ddd-4372-a081-8cfce233d06d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:08.903410 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e2217f1e-4ddd-4372-a081-8cfce233d06d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:08.903926 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e2217f1e-4ddd-4372-a081-8cfce233d06d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:08.932021 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e2217f1e-4ddd-4372-a081-8cfce233d06d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Going to try to terminate instance {{(pid=117552) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:28:09.030344 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-e2217f1e-4ddd-4372-a081-8cfce233d06d tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "DELETE /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 204 len: 0 microversion: 2.1 time: 0.140601 Jun 16 17:28:09.031158 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 335/673] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:28:08 2022] DELETE /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:28:09.043695 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-cef4c54c-7e59-4832-98ca-061ae9ea71c4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:09.044603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-cef4c54c-7e59-4832-98ca-061ae9ea71c4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:09.051730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cef4c54c-7e59-4832-98ca-061ae9ea71c4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:09.052192 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cef4c54c-7e59-4832-98ca-061ae9ea71c4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:09.055892 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cef4c54c-7e59-4832-98ca-061ae9ea71c4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:09.055892 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cef4c54c-7e59-4832-98ca-061ae9ea71c4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:09.074274 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-99c783b1-b56a-4b87-9fef-cc40c63dd15a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:09.075657 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-99c783b1-b56a-4b87-9fef-cc40c63dd15a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:09.081723 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-99c783b1-b56a-4b87-9fef-cc40c63dd15a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:09.082165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-99c783b1-b56a-4b87-9fef-cc40c63dd15a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:09.082923 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-99c783b1-b56a-4b87-9fef-cc40c63dd15a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:09.083353 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-99c783b1-b56a-4b87-9fef-cc40c63dd15a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:09.215664 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-cef4c54c-7e59-4832-98ca-061ae9ea71c4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:09.226340 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-cef4c54c-7e59-4832-98ca-061ae9ea71c4 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.188007 Jun 16 17:28:09.226924 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 339/674] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:09 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:09.236967 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-99c783b1-b56a-4b87-9fef-cc40c63dd15a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:09.244675 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-99c783b1-b56a-4b87-9fef-cc40c63dd15a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1364 microversion: 2.1 time: 0.175194 Jun 16 17:28:09.245259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 336/675] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:09 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:10.244516 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-9072ee92-957e-4b8e-a945-30ed94e6eb8b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:10.245147 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-9072ee92-957e-4b8e-a945-30ed94e6eb8b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:10.252407 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9072ee92-957e-4b8e-a945-30ed94e6eb8b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:10.252858 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9072ee92-957e-4b8e-a945-30ed94e6eb8b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:10.253665 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9072ee92-957e-4b8e-a945-30ed94e6eb8b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:10.254096 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9072ee92-957e-4b8e-a945-30ed94e6eb8b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:10.262163 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c7d29ed4-ac83-4e71-97cf-fbe36f633dd2 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:10.262845 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c7d29ed4-ac83-4e71-97cf-fbe36f633dd2 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:10.270430 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c7d29ed4-ac83-4e71-97cf-fbe36f633dd2 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:10.270957 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c7d29ed4-ac83-4e71-97cf-fbe36f633dd2 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:10.272022 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c7d29ed4-ac83-4e71-97cf-fbe36f633dd2 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:10.272482 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c7d29ed4-ac83-4e71-97cf-fbe36f633dd2 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:10.410157 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-9072ee92-957e-4b8e-a945-30ed94e6eb8b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:10.418035 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-9072ee92-957e-4b8e-a945-30ed94e6eb8b tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.177764 Jun 16 17:28:10.418924 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 340/676] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:10 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:10.437383 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c7d29ed4-ac83-4e71-97cf-fbe36f633dd2 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:10.446715 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c7d29ed4-ac83-4e71-97cf-fbe36f633dd2 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1364 microversion: 2.1 time: 0.188258 Jun 16 17:28:10.447293 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 337/677] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:10 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:11.436980 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8c260549-c31f-4508-8931-7ae3d206e09e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:11.437554 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-8c260549-c31f-4508-8931-7ae3d206e09e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:11.445421 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8c260549-c31f-4508-8931-7ae3d206e09e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:11.445889 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8c260549-c31f-4508-8931-7ae3d206e09e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:11.446661 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8c260549-c31f-4508-8931-7ae3d206e09e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:11.447072 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8c260549-c31f-4508-8931-7ae3d206e09e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:11.464197 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-263252f3-4b40-4459-9a86-5e4aaf84d0a4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:11.464804 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-263252f3-4b40-4459-9a86-5e4aaf84d0a4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:11.471818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-263252f3-4b40-4459-9a86-5e4aaf84d0a4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:11.472452 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-263252f3-4b40-4459-9a86-5e4aaf84d0a4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:11.473368 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-263252f3-4b40-4459-9a86-5e4aaf84d0a4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:11.473900 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-263252f3-4b40-4459-9a86-5e4aaf84d0a4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:11.605841 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8c260549-c31f-4508-8931-7ae3d206e09e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:11.614452 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8c260549-c31f-4508-8931-7ae3d206e09e tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.181465 Jun 16 17:28:11.615046 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 341/678] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:11 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:11.630777 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-263252f3-4b40-4459-9a86-5e4aaf84d0a4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:11.639201 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-263252f3-4b40-4459-9a86-5e4aaf84d0a4 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1364 microversion: 2.1 time: 0.178797 Jun 16 17:28:11.640150 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 338/679] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:11 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:12.633750 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-3681b601-6204-4a79-b1b0-49a9762d3163 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:12.634342 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-3681b601-6204-4a79-b1b0-49a9762d3163 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:12.641399 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3681b601-6204-4a79-b1b0-49a9762d3163 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:12.641841 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3681b601-6204-4a79-b1b0-49a9762d3163 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:12.642604 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3681b601-6204-4a79-b1b0-49a9762d3163 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:12.643031 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3681b601-6204-4a79-b1b0-49a9762d3163 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:12.657597 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b5db72c7-7cb9-4bce-ba8f-2a80c6d634fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:12.658507 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b5db72c7-7cb9-4bce-ba8f-2a80c6d634fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:12.665198 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b5db72c7-7cb9-4bce-ba8f-2a80c6d634fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:12.665655 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b5db72c7-7cb9-4bce-ba8f-2a80c6d634fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:12.666437 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b5db72c7-7cb9-4bce-ba8f-2a80c6d634fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:12.666866 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b5db72c7-7cb9-4bce-ba8f-2a80c6d634fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:12.686435 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:12.803565 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-3681b601-6204-4a79-b1b0-49a9762d3163 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:12.812414 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-3681b601-6204-4a79-b1b0-49a9762d3163 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1521 microversion: 2.1 time: 0.183426 Jun 16 17:28:12.812752 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 342/680] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:12 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:12.882657 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-b5db72c7-7cb9-4bce-ba8f-2a80c6d634fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:12.891976 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b5db72c7-7cb9-4bce-ba8f-2a80c6d634fe tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1364 microversion: 2.1 time: 0.238286 Jun 16 17:28:12.892551 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 339/681] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:12 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:13.455941 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-f1a9b929-2432-43ec-a020-a310875352c7 req-e833a5e7-c47f-4d0e-8d95-36013f25ecd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ea9630-ef03-47fd-aa60-695a36081c19", "name": "network-vif-deleted", "tag": "6fa0a160-b8b9-480d-91ad-c84aa7d2485a"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:28:13.461817 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=6 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:13.467178 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-f1a9b929-2432-43ec-a020-a310875352c7 req-e833a5e7-c47f-4d0e-8d95-36013f25ecd5 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:13.467635 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-f1a9b929-2432-43ec-a020-a310875352c7 req-e833a5e7-c47f-4d0e-8d95-36013f25ecd5 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:13.482598 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-f1a9b929-2432-43ec-a020-a310875352c7 req-e833a5e7-c47f-4d0e-8d95-36013f25ecd5 service nova] Creating event network-vif-deleted:6fa0a160-b8b9-480d-91ad-c84aa7d2485a for instance 90ea9630-ef03-47fd-aa60-695a36081c19 on hv-cinder-83735 Jun 16 17:28:13.489463 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-f1a9b929-2432-43ec-a020-a310875352c7 req-e833a5e7-c47f-4d0e-8d95-36013f25ecd5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036999 Jun 16 17:28:13.490313 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 343/682] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:28:13.827134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:13.829024 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=6 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:13.839706 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-1d8a349f-399f-46b8-a6f4-a17c9ed3709c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:13.840736 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-1d8a349f-399f-46b8-a6f4-a17c9ed3709c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:13.849032 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1d8a349f-399f-46b8-a6f4-a17c9ed3709c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:13.849854 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1d8a349f-399f-46b8-a6f4-a17c9ed3709c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:13.850886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1d8a349f-399f-46b8-a6f4-a17c9ed3709c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:13.851542 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1d8a349f-399f-46b8-a6f4-a17c9ed3709c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:13.894148 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1d8a349f-399f-46b8-a6f4-a17c9ed3709c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:13.895035 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1d8a349f-399f-46b8-a6f4-a17c9ed3709c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:13.895035 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.objects.instance [None req-1d8a349f-399f-46b8-a6f4-a17c9ed3709c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lazy-loading 'fault' on Instance uuid 90ea9630-ef03-47fd-aa60-695a36081c19 {{(pid=117552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:28:13.912402 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a5b516b7-b117-4f4b-8cd9-aaab84451fd6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:13.913783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a5b516b7-b117-4f4b-8cd9-aaab84451fd6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:13.923446 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a5b516b7-b117-4f4b-8cd9-aaab84451fd6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:13.923869 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a5b516b7-b117-4f4b-8cd9-aaab84451fd6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:13.924828 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a5b516b7-b117-4f4b-8cd9-aaab84451fd6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:13.925505 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a5b516b7-b117-4f4b-8cd9-aaab84451fd6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:13.963719 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-1d8a349f-399f-46b8-a6f4-a17c9ed3709c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8a309f6914d83b8e72bc60a5d7924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5c45783454fc5a7872490196f07e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:13.977045 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-1d8a349f-399f-46b8-a6f4-a17c9ed3709c tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 200 len: 1311 microversion: 2.1 time: 0.150385 Jun 16 17:28:13.978431 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 340/683] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:13 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 1311 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:28:14.132938 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a5b516b7-b117-4f4b-8cd9-aaab84451fd6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:14.140786 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a5b516b7-b117-4f4b-8cd9-aaab84451fd6 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1364 microversion: 2.1 time: 0.233275 Jun 16 17:28:14.141435 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 344/684] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:13 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:28:14.999689 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-563df603-983b-4b4f-a023-40b8654bc035 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:15.000450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-563df603-983b-4b4f-a023-40b8654bc035 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] [instance: 90ea9630-ef03-47fd-aa60-695a36081c19] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:15.008417 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-563df603-983b-4b4f-a023-40b8654bc035 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:15.008855 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-563df603-983b-4b4f-a023-40b8654bc035 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:15.009675 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-563df603-983b-4b4f-a023-40b8654bc035 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:15.010144 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-563df603-983b-4b4f-a023-40b8654bc035 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:15.026080 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-563df603-983b-4b4f-a023-40b8654bc035 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] HTTP exception thrown: Instance 90ea9630-ef03-47fd-aa60-695a36081c19 could not be found. Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-563df603-983b-4b4f-a023-40b8654bc035 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Request method failure captured: Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 HTTP/1.1 Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2baiTAiiIqvs05AAgXEGNrzgTOS0KD51O8IrwALK_82kaIh4oIhGWJGUbDxg3s9UADdVPKzO_ZDdu65W2o4SzEeVM38vngvZj4zT9_ojpKoesbQIclVOSFNU9SjyczrwaH1BGy99G4f7f3jUdIV6_zsnlingiczP1owxkwlv_alFaA Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: ccf5c45783454fc5a7872490196f07e0 Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1475515620 Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:28:15.027791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:28:15.029536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ccf5c45783454fc5a7872490196f07e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ccf5c45783454fc5a7872490196f07e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ccf5c45783454fc5a7872490196f07e0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ccf5c45783454fc5a7872490196f07e0"}]}] Jun 16 17:28:15.029536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1475515620 Jun 16 17:28:15.029536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: ccf5c45783454fc5a7872490196f07e0 Jun 16 17:28:15.029536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1475515620 Jun 16 17:28:15.029536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-ServerRescueNegativeTestJSON-1475515620-project Jun 16 17:28:15.029536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:28:15.029536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:28:15.029536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 0cd8a309f6914d83b8e72bc60a5d7924 Jun 16 17:28:15.029536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1475515620-project Jun 16 17:28:15.029536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:28:15.029536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance 90ea9630-ef03-47fd-aa60-695a36081c19 could not be found. Jun 16 17:28:15.029536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': '90ea9630-ef03-47fd-aa60-695a36081c19'} Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ea9630-ef03-47fd-aa60-695a36081c19 could not be found. Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:28:15.030462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ea9630-ef03-47fd-aa60-695a36081c19 could not be found. Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ea9630-ef03-47fd-aa60-695a36081c19 could not be found. Jun 16 17:28:15.031910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:15.033247 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-563df603-983b-4b4f-a023-40b8654bc035 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] Returning 404 to user: Instance 90ea9630-ef03-47fd-aa60-695a36081c19 could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:28:15.033247 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-563df603-983b-4b4f-a023-40b8654bc035 tempest-ServerRescueNegativeTestJSON-1475515620 tempest-ServerRescueNegativeTestJSON-1475515620-project] 10.222.0.66 "GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19" status: 404 len: 111 microversion: 2.1 time: 0.034218 Jun 16 17:28:15.033431 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 341/685] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:14 2022] GET /compute/v2.1/servers/90ea9630-ef03-47fd-aa60-695a36081c19 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:28:15.159900 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f8bc8042-fd0d-4842-af11-2484dc7b4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:15.160782 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f8bc8042-fd0d-4842-af11-2484dc7b4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:15.172283 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f8bc8042-fd0d-4842-af11-2484dc7b4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:15.173303 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f8bc8042-fd0d-4842-af11-2484dc7b4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:15.174958 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f8bc8042-fd0d-4842-af11-2484dc7b4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:15.175861 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f8bc8042-fd0d-4842-af11-2484dc7b4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:15.667521 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-f8bc8042-fd0d-4842-af11-2484dc7b4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:15.678435 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f8bc8042-fd0d-4842-af11-2484dc7b4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1364 microversion: 2.1 time: 0.522274 Jun 16 17:28:15.679112 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 345/686] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:15 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1364 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:16.593447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-86afa05d-fc3c-454e-a8c3-4adf888f115f req-262f9903-3b71-4b9d-848b-035865fd2dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeb07519-2ce6-44ee-a88c-d46b4e11b367", "name": "network-vif-plugged", "status": "completed", "tag": "7176d454-867c-4dc6-b412-5623b5292926"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:28:16.621878 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-86afa05d-fc3c-454e-a8c3-4adf888f115f req-262f9903-3b71-4b9d-848b-035865fd2dc7 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:16.623378 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-86afa05d-fc3c-454e-a8c3-4adf888f115f req-262f9903-3b71-4b9d-848b-035865fd2dc7 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:16.645588 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-86afa05d-fc3c-454e-a8c3-4adf888f115f req-262f9903-3b71-4b9d-848b-035865fd2dc7 service nova] Creating event network-vif-plugged:7176d454-867c-4dc6-b412-5623b5292926 for instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 on hv-cinder-83735 Jun 16 17:28:16.654241 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-86afa05d-fc3c-454e-a8c3-4adf888f115f req-262f9903-3b71-4b9d-848b-035865fd2dc7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064744 Jun 16 17:28:16.656061 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 342/687] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:28:16.702484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-90999394-07a2-4d2f-b6ec-75f9509120e9 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:16.703577 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-90999394-07a2-4d2f-b6ec-75f9509120e9 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:16.728635 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-90999394-07a2-4d2f-b6ec-75f9509120e9 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:16.729749 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-90999394-07a2-4d2f-b6ec-75f9509120e9 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:16.731367 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-90999394-07a2-4d2f-b6ec-75f9509120e9 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:16.732454 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-90999394-07a2-4d2f-b6ec-75f9509120e9 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:17.064508 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-90999394-07a2-4d2f-b6ec-75f9509120e9 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:17.078710 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-90999394-07a2-4d2f-b6ec-75f9509120e9 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1364 microversion: 2.1 time: 0.383582 Jun 16 17:28:17.079320 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 346/688] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:16 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1364 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:28:18.097104 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-4cfc58e5-68f1-4e06-aee8-bdbc86427255 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:18.097913 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-4cfc58e5-68f1-4e06-aee8-bdbc86427255 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:18.104912 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4cfc58e5-68f1-4e06-aee8-bdbc86427255 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:18.105393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4cfc58e5-68f1-4e06-aee8-bdbc86427255 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:18.106154 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4cfc58e5-68f1-4e06-aee8-bdbc86427255 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:18.106703 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4cfc58e5-68f1-4e06-aee8-bdbc86427255 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:18.271757 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-4cfc58e5-68f1-4e06-aee8-bdbc86427255 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:18.280571 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-4cfc58e5-68f1-4e06-aee8-bdbc86427255 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1364 microversion: 2.1 time: 0.188163 Jun 16 17:28:18.289419 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 343/689] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:18 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:19.298146 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-885a223f-756f-4220-88a8-1c63f936becc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:19.299465 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-885a223f-756f-4220-88a8-1c63f936becc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:19.309073 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-885a223f-756f-4220-88a8-1c63f936becc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:19.309850 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-885a223f-756f-4220-88a8-1c63f936becc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:19.311007 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-885a223f-756f-4220-88a8-1c63f936becc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:19.311631 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-885a223f-756f-4220-88a8-1c63f936becc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:19.501301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-885a223f-756f-4220-88a8-1c63f936becc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:19.508979 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-885a223f-756f-4220-88a8-1c63f936becc tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1550 microversion: 2.1 time: 0.215281 Jun 16 17:28:19.509670 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 347/690] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:19 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1550 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:19.526629 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e3ceb9ce-417a-4a10-bfbe-04b67433c56d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:19.527145 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e3ceb9ce-417a-4a10-bfbe-04b67433c56d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:19.533721 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e3ceb9ce-417a-4a10-bfbe-04b67433c56d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:19.534167 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e3ceb9ce-417a-4a10-bfbe-04b67433c56d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:19.534948 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e3ceb9ce-417a-4a10-bfbe-04b67433c56d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:19.535395 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e3ceb9ce-417a-4a10-bfbe-04b67433c56d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:19.640066 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-e3ceb9ce-417a-4a10-bfbe-04b67433c56d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117758 Jun 16 17:28:19.640702 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 344/691] 10.222.0.66 () {58 vars in 1274 bytes} [Thu Jun 16 17:28:19 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:28:20.656570 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-853cf1a2-99db-4349-9d82-c3a990f9b9a7 tempest-VolumesGetTestJSON-393636319 tempest-VolumesGetTestJSON-393636319-project] Action: 'create', calling method: .version_select at 0x7f66b159d160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-931777686", "metadata": {"Type": "work"}}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:28:20.928417 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-0d0a3e54-cf4a-4817-a182-cc9a7c527802 req-9b0a94d1-cb09-44fd-b641-e772a8ed7244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeb07519-2ce6-44ee-a88c-d46b4e11b367", "tag": "7176d454-867c-4dc6-b412-5623b5292926"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:28:20.936532 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-0d0a3e54-cf4a-4817-a182-cc9a7c527802 req-9b0a94d1-cb09-44fd-b641-e772a8ed7244 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:20.937218 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-0d0a3e54-cf4a-4817-a182-cc9a7c527802 req-9b0a94d1-cb09-44fd-b641-e772a8ed7244 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:20.948857 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-0d0a3e54-cf4a-4817-a182-cc9a7c527802 req-9b0a94d1-cb09-44fd-b641-e772a8ed7244 service nova] Creating event network-changed:7176d454-867c-4dc6-b412-5623b5292926 for instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 on hv-cinder-83735 Jun 16 17:28:20.955336 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-0d0a3e54-cf4a-4817-a182-cc9a7c527802 req-9b0a94d1-cb09-44fd-b641-e772a8ed7244 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031539 Jun 16 17:28:20.956359 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 345/692] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:28:21.004453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-853cf1a2-99db-4349-9d82-c3a990f9b9a7 tempest-VolumesGetTestJSON-393636319 tempest-VolumesGetTestJSON-393636319-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.472480 Jun 16 17:28:21.005012 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 348/693] 10.222.0.66 () {60 vars in 1155 bytes} [Thu Jun 16 17:28:20 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 474 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 17:28:21.017854 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7f1f91fe-38f0-4a48-848d-9b3e908ac2a4 tempest-VolumesGetTestJSON-393636319 tempest-VolumesGetTestJSON-393636319-project] Calling method '.version_select at 0x7f66b15ae040>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:21.071885 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7f1f91fe-38f0-4a48-848d-9b3e908ac2a4 tempest-VolumesGetTestJSON-393636319 tempest-VolumesGetTestJSON-393636319-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/f7fc0d85-0acb-4e25-94d4-721a3c7a44cb" status: 200 len: 352 microversion: 2.1 time: 0.059220 Jun 16 17:28:21.072537 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 346/694] 10.222.0.66 () {58 vars in 1244 bytes} [Thu Jun 16 17:28:21 2022] GET /compute/v2.1/os-volumes/f7fc0d85-0acb-4e25-94d4-721a3c7a44cb => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:28:22.085342 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-06acf448-e9b3-4cc5-bb03-d5a69bb9a546 tempest-VolumesGetTestJSON-393636319 tempest-VolumesGetTestJSON-393636319-project] Calling method '.version_select at 0x7f66b172d940>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:22.132911 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-06acf448-e9b3-4cc5-bb03-d5a69bb9a546 tempest-VolumesGetTestJSON-393636319 tempest-VolumesGetTestJSON-393636319-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/f7fc0d85-0acb-4e25-94d4-721a3c7a44cb" status: 200 len: 353 microversion: 2.1 time: 0.051961 Jun 16 17:28:22.133593 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 349/695] 10.222.0.66 () {58 vars in 1244 bytes} [Thu Jun 16 17:28:22 2022] GET /compute/v2.1/os-volumes/f7fc0d85-0acb-4e25-94d4-721a3c7a44cb => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:28:22.145122 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-417f3add-f9a4-4864-9351-b8e7aa96648d tempest-VolumesGetTestJSON-393636319 tempest-VolumesGetTestJSON-393636319-project] Calling method '.version_select at 0x7f66b156eaf0>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:22.192589 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-417f3add-f9a4-4864-9351-b8e7aa96648d tempest-VolumesGetTestJSON-393636319 tempest-VolumesGetTestJSON-393636319-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/f7fc0d85-0acb-4e25-94d4-721a3c7a44cb" status: 200 len: 353 microversion: 2.1 time: 0.051713 Jun 16 17:28:22.193234 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 347/696] 10.222.0.66 () {58 vars in 1244 bytes} [Thu Jun 16 17:28:22 2022] GET /compute/v2.1/os-volumes/f7fc0d85-0acb-4e25-94d4-721a3c7a44cb => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:28:22.209577 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-21fc9c0f-e92a-47c5-93fa-1340d7824f01 tempest-VolumesGetTestJSON-393636319 tempest-VolumesGetTestJSON-393636319-project] Calling method '.version_select at 0x7f66b1439040>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:22.275644 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-21fc9c0f-e92a-47c5-93fa-1340d7824f01 tempest-VolumesGetTestJSON-393636319 tempest-VolumesGetTestJSON-393636319-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/f7fc0d85-0acb-4e25-94d4-721a3c7a44cb" status: 202 len: 0 microversion: 2.1 time: 0.070105 Jun 16 17:28:22.276208 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 350/697] 10.222.0.66 () {58 vars in 1247 bytes} [Thu Jun 16 17:28:22 2022] DELETE /compute/v2.1/os-volumes/f7fc0d85-0acb-4e25-94d4-721a3c7a44cb => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:28:22.284207 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-dca1a031-63c5-4f94-bc5e-eb1026f88537 tempest-VolumesGetTestJSON-393636319 tempest-VolumesGetTestJSON-393636319-project] Calling method '.version_select at 0x7f66b156e550>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:22.334469 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-dca1a031-63c5-4f94-bc5e-eb1026f88537 tempest-VolumesGetTestJSON-393636319 tempest-VolumesGetTestJSON-393636319-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/f7fc0d85-0acb-4e25-94d4-721a3c7a44cb" status: 200 len: 352 microversion: 2.1 time: 0.053981 Jun 16 17:28:22.335404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 348/698] 10.222.0.66 () {58 vars in 1244 bytes} [Thu Jun 16 17:28:22 2022] GET /compute/v2.1/os-volumes/f7fc0d85-0acb-4e25-94d4-721a3c7a44cb => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:28:23.348741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a5fb2f6c-de84-4c69-9236-93428ac6a0d3 tempest-VolumesGetTestJSON-393636319 tempest-VolumesGetTestJSON-393636319-project] Calling method '.version_select at 0x7f66b15d74c0>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:23.386746 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-a5fb2f6c-de84-4c69-9236-93428ac6a0d3 tempest-VolumesGetTestJSON-393636319 tempest-VolumesGetTestJSON-393636319-project] HTTP exception thrown: Volume f7fc0d85-0acb-4e25-94d4-721a3c7a44cb could not be found. Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a5fb2f6c-de84-4c69-9236-93428ac6a0d3 tempest-VolumesGetTestJSON-393636319 tempest-VolumesGetTestJSON-393636319-project] Request method failure captured: Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/os-volumes/f7fc0d85-0acb-4e25-94d4-721a3c7a44cb HTTP/1.1 Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2g0coLRkkw66xwgI9yUT9C8K0yt5x9PRQdpuUCFE1EwkjzQyg-eLuvfCM2a46YSJcG--PS2nS8E9nNkpZ2DxC0Rr4QU6QmIBn0EJHRQb7r42-64u72cPkR6RraCizc6XxAZkCFp349RVJDQOkRKl9I2KabKshT_U_RALDWFEwilfp4 Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: a0dcae29f5be488baacf188d90fa757d Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-VolumesGetTestJSON-393636319 Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:28:23.388793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:28:23.390392 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a0dcae29f5be488baacf188d90fa757d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a0dcae29f5be488baacf188d90fa757d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a0dcae29f5be488baacf188d90fa757d", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a0dcae29f5be488baacf188d90fa757d"}]}] Jun 16 17:28:23.390392 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-VolumesGetTestJSON-393636319 Jun 16 17:28:23.390392 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: a0dcae29f5be488baacf188d90fa757d Jun 16 17:28:23.390392 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-VolumesGetTestJSON-393636319 Jun 16 17:28:23.390392 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-VolumesGetTestJSON-393636319-project Jun 16 17:28:23.390392 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:28:23.390392 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:28:23.390392 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: 917d3cbaedfe42e891997bf92b465224 Jun 16 17:28:23.390392 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-VolumesGetTestJSON-393636319-project Jun 16 17:28:23.390392 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: Jun 16 17:28:23.390392 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Volume f7fc0d85-0acb-4e25-94d4-721a3c7a44cb could not be found. Jun 16 17:28:23.390392 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': 'f7fc0d85-0acb-4e25-94d4-721a3c7a44cb'} Jun 16 17:28:23.390392 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7fc0d85-0acb-4e25-94d4-721a3c7a44cb could not be found. (HTTP 404) (Request-ID: req-b789aba5-f941-4367-8a92-ef6cd6ff5ef1) Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:28:23.391751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:28:23.393251 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7fc0d85-0acb-4e25-94d4-721a3c7a44cb could not be found. Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 17:28:23.394689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:28:23.396191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7fc0d85-0acb-4e25-94d4-721a3c7a44cb could not be found. Jun 16 17:28:23.396191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:28:23.396191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:28:23.396191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:28:23.396191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:23.396191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:28:23.396191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:28:23.396191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:28:23.396191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:28:23.396191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7fc0d85-0acb-4e25-94d4-721a3c7a44cb could not be found. Jun 16 17:28:23.396191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:28:23.396191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a5fb2f6c-de84-4c69-9236-93428ac6a0d3 tempest-VolumesGetTestJSON-393636319 tempest-VolumesGetTestJSON-393636319-project] Returning 404 to user: Volume f7fc0d85-0acb-4e25-94d4-721a3c7a44cb could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:28:23.396191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a5fb2f6c-de84-4c69-9236-93428ac6a0d3 tempest-VolumesGetTestJSON-393636319 tempest-VolumesGetTestJSON-393636319-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/f7fc0d85-0acb-4e25-94d4-721a3c7a44cb" status: 404 len: 109 microversion: 2.1 time: 0.046992 Jun 16 17:28:23.396191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 351/699] 10.222.0.66 () {58 vars in 1244 bytes} [Thu Jun 16 17:28:23 2022] GET /compute/v2.1/os-volumes/f7fc0d85-0acb-4e25-94d4-721a3c7a44cb => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:28:31.550264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:31.551022 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=26 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:31.555257 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-1865b5cf-f261-4d48-878d-6ff8138641bb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1613302764"}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:28:31.555886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-1865b5cf-f261-4d48-878d-6ff8138641bb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:31.563859 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1865b5cf-f261-4d48-878d-6ff8138641bb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:31.564302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1865b5cf-f261-4d48-878d-6ff8138641bb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:31.565077 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1865b5cf-f261-4d48-878d-6ff8138641bb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:31.565538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1865b5cf-f261-4d48-878d-6ff8138641bb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:31.704454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.network.security_group_api [None req-1865b5cf-f261-4d48-878d-6ff8138641bb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Removing security group 66f70e9b-7bf4-4a7a-a0da-bf4af5a755fa from port 676f9af5-715a-4f80-b6f8-747296e84e2c Jun 16 17:28:32.073695 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-1865b5cf-f261-4d48-878d-6ff8138641bb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "POST /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54/action" status: 202 len: 0 microversion: 2.1 time: 0.524826 Jun 16 17:28:32.079817 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 349/700] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jun 16 17:28:31 2022] POST /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:28:32.094704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-30ab44f1-937b-40ce-ad91-db715505de81 req-ec886b2d-052b-44d2-9895-9edf05010562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ee9b10-f2da-442c-9475-3cfb21c9ad54", "tag": "676f9af5-715a-4f80-b6f8-747296e84e2c"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:28:32.099891 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:32.100572 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=68 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:32.110979 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-30ab44f1-937b-40ce-ad91-db715505de81 req-ec886b2d-052b-44d2-9895-9edf05010562 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:32.111661 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-30ab44f1-937b-40ce-ad91-db715505de81 req-ec886b2d-052b-44d2-9895-9edf05010562 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:32.148395 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-30ab44f1-937b-40ce-ad91-db715505de81 req-ec886b2d-052b-44d2-9895-9edf05010562 service nova] Creating event network-changed:676f9af5-715a-4f80-b6f8-747296e84e2c for instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 on hv-cinder-83735 Jun 16 17:28:32.153845 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-30ab44f1-937b-40ce-ad91-db715505de81 req-ec886b2d-052b-44d2-9895-9edf05010562 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071213 Jun 16 17:28:32.154744 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 352/701] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:28:33.500841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-2b2945c2-b8e7-4ed0-9751-a53a74dd8f8f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:33.501390 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-2b2945c2-b8e7-4ed0-9751-a53a74dd8f8f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:33.508551 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2b2945c2-b8e7-4ed0-9751-a53a74dd8f8f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:33.508990 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2b2945c2-b8e7-4ed0-9751-a53a74dd8f8f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:33.509799 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2b2945c2-b8e7-4ed0-9751-a53a74dd8f8f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:33.510225 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2b2945c2-b8e7-4ed0-9751-a53a74dd8f8f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:33.595204 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.objects.instance [None req-2b2945c2-b8e7-4ed0-9751-a53a74dd8f8f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lazy-loading 'services' on Instance uuid b4ee9b10-f2da-442c-9475-3cfb21c9ad54 {{(pid=117552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:28:33.674651 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-2b2945c2-b8e7-4ed0-9751-a53a74dd8f8f tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54/os-volume_attachments/73bbafb4-a61a-45be-9374-ee4e8dd4702a" status: 202 len: 0 microversion: 2.1 time: 0.178024 Jun 16 17:28:33.675567 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 350/702] 10.222.0.66 () {58 vars in 1415 bytes} [Thu Jun 16 17:28:33 2022] DELETE /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54/os-volume_attachments/73bbafb4-a61a-45be-9374-ee4e8dd4702a => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:28:33.686437 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-92ea4804-d93e-49d0-aa24-ed16ef98d5df tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:33.686808 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-92ea4804-d93e-49d0-aa24-ed16ef98d5df tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:33.694698 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-92ea4804-d93e-49d0-aa24-ed16ef98d5df tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:33.695140 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-92ea4804-d93e-49d0-aa24-ed16ef98d5df tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:33.695912 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-92ea4804-d93e-49d0-aa24-ed16ef98d5df tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:33.696335 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-92ea4804-d93e-49d0-aa24-ed16ef98d5df tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:33.728938 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-92ea4804-d93e-49d0-aa24-ed16ef98d5df tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048424 Jun 16 17:28:33.729711 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 353/703] 10.222.0.66 () {58 vars in 1301 bytes} [Thu Jun 16 17:28:33 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:28:34.171170 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-0fd052f4-ac30-4d29-a54c-c72b967318da req-d08d65c8-8e6e-42b7-9323-0953bc6dffa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ee9b10-f2da-442c-9475-3cfb21c9ad54", "tag": "676f9af5-715a-4f80-b6f8-747296e84e2c"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:28:34.181890 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-0fd052f4-ac30-4d29-a54c-c72b967318da req-d08d65c8-8e6e-42b7-9323-0953bc6dffa6 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:34.182798 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-0fd052f4-ac30-4d29-a54c-c72b967318da req-d08d65c8-8e6e-42b7-9323-0953bc6dffa6 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:34.198990 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-0fd052f4-ac30-4d29-a54c-c72b967318da req-d08d65c8-8e6e-42b7-9323-0953bc6dffa6 service nova] Creating event network-changed:676f9af5-715a-4f80-b6f8-747296e84e2c for instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 on hv-cinder-83735 Jun 16 17:28:34.205679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-0fd052f4-ac30-4d29-a54c-c72b967318da req-d08d65c8-8e6e-42b7-9323-0953bc6dffa6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039572 Jun 16 17:28:34.207285 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 351/704] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:28:34.740482 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-47cd7a5a-8c0c-485b-88c5-2a9d59c13ecf tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:34.742270 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-47cd7a5a-8c0c-485b-88c5-2a9d59c13ecf tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:34.749418 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-47cd7a5a-8c0c-485b-88c5-2a9d59c13ecf tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:34.750268 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-47cd7a5a-8c0c-485b-88c5-2a9d59c13ecf tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:34.751603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-47cd7a5a-8c0c-485b-88c5-2a9d59c13ecf tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:34.752315 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-47cd7a5a-8c0c-485b-88c5-2a9d59c13ecf tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:34.793472 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-47cd7a5a-8c0c-485b-88c5-2a9d59c13ecf tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056919 Jun 16 17:28:34.794689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 354/705] 10.222.0.66 () {58 vars in 1301 bytes} [Thu Jun 16 17:28:34 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:28:34.807459 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-4ef6286c-fd62-4f90-9492-5ad977379205 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:34.808069 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-4ef6286c-fd62-4f90-9492-5ad977379205 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:34.814962 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4ef6286c-fd62-4f90-9492-5ad977379205 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:34.815397 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4ef6286c-fd62-4f90-9492-5ad977379205 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:34.816155 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4ef6286c-fd62-4f90-9492-5ad977379205 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:34.816579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4ef6286c-fd62-4f90-9492-5ad977379205 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:34.898207 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-4ef6286c-fd62-4f90-9492-5ad977379205 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] HTTP exception thrown: Instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 is not attached to volume 73bbafb4-a61a-45be-9374-ee4e8dd4702a Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-4ef6286c-fd62-4f90-9492-5ad977379205 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Request method failure captured: Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: DELETE /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54/os-volume_attachments/73bbafb4-a61a-45be-9374-ee4e8dd4702a HTTP/1.1 Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2dzaDKBm1uE8QUEgNgmALrrteziTt5VLY3wKgoHEAl8SuWvJvB6EMfYthIk8EfX7QAVyFYMnKjt9MPp6Dq01Uu4NodUAyWvTVLxeKBmg82_mDG4eDO8aIQOLBhn9vzkZCvhaUyRJ6S6WqYPUhDzrc9rMxjxpoRmf4iM5eXV4KeCUBQ Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 546929b1810a4d20b273f3e5492ec6ed Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-TestMinimumBasicScenario-140635566 Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:28:34.900609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:28:34.902177 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/546929b1810a4d20b273f3e5492ec6ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/546929b1810a4d20b273f3e5492ec6ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_546929b1810a4d20b273f3e5492ec6ed", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/546929b1810a4d20b273f3e5492ec6ed"}]}] Jun 16 17:28:34.902177 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-TestMinimumBasicScenario-140635566 Jun 16 17:28:34.902177 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 546929b1810a4d20b273f3e5492ec6ed Jun 16 17:28:34.902177 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-TestMinimumBasicScenario-140635566 Jun 16 17:28:34.902177 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-TestMinimumBasicScenario-140635566-project Jun 16 17:28:34.902177 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:28:34.902177 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:28:34.902177 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 71df16d1e792468585702fd688b8d3f2 Jun 16 17:28:34.902177 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-TestMinimumBasicScenario-140635566-project Jun 16 17:28:34.902177 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:28:34.902177 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 is not attached to volume 73bbafb4-a61a-45be-9374-ee4e8dd4702a Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'server_id': 'b4ee9b10-f2da-442c-9475-3cfb21c9ad54', 'id': '73bbafb4-a61a-45be-9374-ee4e8dd4702a'} Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 73bbafb4-a61a-45be-9374-ee4e8dd4702a. Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:28:34.902933 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:28:34.904250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:28:34.904250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 17:28:34.904250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 17:28:34.904250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 is not attached to volume 73bbafb4-a61a-45be-9374-ee4e8dd4702a Jun 16 17:28:34.904250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:34.904250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:28:34.904250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:34.904250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:34.904250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:28:34.904250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:28:34.904250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:28:34.904250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:28:34.904250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 is not attached to volume 73bbafb4-a61a-45be-9374-ee4e8dd4702a Jun 16 17:28:34.904250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:34.904250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-4ef6286c-fd62-4f90-9492-5ad977379205 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Returning 404 to user: Instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 is not attached to volume 73bbafb4-a61a-45be-9374-ee4e8dd4702a {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:28:34.905352 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-4ef6286c-fd62-4f90-9492-5ad977379205 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54/os-volume_attachments/73bbafb4-a61a-45be-9374-ee4e8dd4702a" status: 404 len: 154 microversion: 2.1 time: 0.101764 Jun 16 17:28:34.905352 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 352/706] 10.222.0.66 () {58 vars in 1415 bytes} [Thu Jun 16 17:28:34 2022] DELETE /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54/os-volume_attachments/73bbafb4-a61a-45be-9374-ee4e8dd4702a => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:28:36.054189 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-26eb2548-b244-4dd5-8b8f-7e2311ff6d54 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:36.054707 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-26eb2548-b244-4dd5-8b8f-7e2311ff6d54 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:36.060687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-26eb2548-b244-4dd5-8b8f-7e2311ff6d54 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:36.061135 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-26eb2548-b244-4dd5-8b8f-7e2311ff6d54 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:36.061928 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-26eb2548-b244-4dd5-8b8f-7e2311ff6d54 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:36.062371 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-26eb2548-b244-4dd5-8b8f-7e2311ff6d54 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:36.089432 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-26eb2548-b244-4dd5-8b8f-7e2311ff6d54 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Going to try to terminate instance {{(pid=117553) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:28:36.173084 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-26eb2548-b244-4dd5-8b8f-7e2311ff6d54 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 204 len: 0 microversion: 2.1 time: 0.122650 Jun 16 17:28:36.174094 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 355/707] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:28:36 2022] DELETE /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:28:36.182529 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-734ba6ab-3c50-4539-8064-ea815b4bc8dd tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:36.183133 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-734ba6ab-3c50-4539-8064-ea815b4bc8dd tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:36.189703 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-734ba6ab-3c50-4539-8064-ea815b4bc8dd tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:36.190137 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-734ba6ab-3c50-4539-8064-ea815b4bc8dd tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:36.190887 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-734ba6ab-3c50-4539-8064-ea815b4bc8dd tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:36.191303 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-734ba6ab-3c50-4539-8064-ea815b4bc8dd tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:36.338625 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-734ba6ab-3c50-4539-8064-ea815b4bc8dd tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:36.347909 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-734ba6ab-3c50-4539-8064-ea815b4bc8dd tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1555 microversion: 2.1 time: 0.169434 Jun 16 17:28:36.348470 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 353/708] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:36 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:37.366471 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4f659f19-e7be-4e51-9c3b-b0aee7aac0eb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:37.367184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4f659f19-e7be-4e51-9c3b-b0aee7aac0eb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:37.374148 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4f659f19-e7be-4e51-9c3b-b0aee7aac0eb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:37.374591 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4f659f19-e7be-4e51-9c3b-b0aee7aac0eb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:37.375353 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4f659f19-e7be-4e51-9c3b-b0aee7aac0eb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:37.375780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4f659f19-e7be-4e51-9c3b-b0aee7aac0eb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:37.525100 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4f659f19-e7be-4e51-9c3b-b0aee7aac0eb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:37.537163 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4f659f19-e7be-4e51-9c3b-b0aee7aac0eb tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1555 microversion: 2.1 time: 0.174706 Jun 16 17:28:37.537971 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 356/709] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:37 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:38.554845 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5760eb66-bb69-4f24-9a42-79e682357075 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:38.555519 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-5760eb66-bb69-4f24-9a42-79e682357075 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:38.563202 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5760eb66-bb69-4f24-9a42-79e682357075 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:38.563656 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5760eb66-bb69-4f24-9a42-79e682357075 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:38.564503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5760eb66-bb69-4f24-9a42-79e682357075 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:38.564938 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5760eb66-bb69-4f24-9a42-79e682357075 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:38.703320 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5760eb66-bb69-4f24-9a42-79e682357075 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71df16d1e792468585702fd688b8d3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546929b1810a4d20b273f3e5492ec6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:38.712499 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-5760eb66-bb69-4f24-9a42-79e682357075 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 200 len: 1555 microversion: 2.1 time: 0.161529 Jun 16 17:28:38.713087 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 354/710] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:38 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:38.984772 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-93fa30f1-055a-492b-9896-a4ec88dabd78 req-8b21ee3c-f13b-4944-834e-37fdf3d42ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ee9b10-f2da-442c-9475-3cfb21c9ad54", "name": "network-vif-deleted", "tag": "676f9af5-715a-4f80-b6f8-747296e84e2c"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:28:38.996087 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-93fa30f1-055a-492b-9896-a4ec88dabd78 req-8b21ee3c-f13b-4944-834e-37fdf3d42ecd service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:38.996536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-93fa30f1-055a-492b-9896-a4ec88dabd78 req-8b21ee3c-f13b-4944-834e-37fdf3d42ecd service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:39.009061 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-93fa30f1-055a-492b-9896-a4ec88dabd78 req-8b21ee3c-f13b-4944-834e-37fdf3d42ecd service nova] Creating event network-vif-deleted:676f9af5-715a-4f80-b6f8-747296e84e2c for instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 on hv-cinder-83735 Jun 16 17:28:39.014256 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-93fa30f1-055a-492b-9896-a4ec88dabd78 req-8b21ee3c-f13b-4944-834e-37fdf3d42ecd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033447 Jun 16 17:28:39.014821 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 357/711] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:28:39.730872 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a94a8a8a-6a2e-41ac-9e21-31228c95a881 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:39.732278 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a94a8a8a-6a2e-41ac-9e21-31228c95a881 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] [instance: b4ee9b10-f2da-442c-9475-3cfb21c9ad54] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:39.741862 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a94a8a8a-6a2e-41ac-9e21-31228c95a881 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:39.742637 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a94a8a8a-6a2e-41ac-9e21-31228c95a881 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:39.743460 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a94a8a8a-6a2e-41ac-9e21-31228c95a881 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:39.743862 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a94a8a8a-6a2e-41ac-9e21-31228c95a881 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:39.763832 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-a94a8a8a-6a2e-41ac-9e21-31228c95a881 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] HTTP exception thrown: Instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 could not be found. Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a94a8a8a-6a2e-41ac-9e21-31228c95a881 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Request method failure captured: Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 HTTP/1.1 Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2dzaDKBm1uE8QUEgNgmALrrteziTt5VLY3wKgoHEAl8SuWvJvB6EMfYthIk8EfX7QAVyFYMnKjt9MPp6Dq01Uu4NodUAyWvTVLxeKBmg82_mDG4eDO8aIQOLBhn9vzkZCvhaUyRJ6S6WqYPUhDzrc9rMxjxpoRmf4iM5eXV4KeCUBQ Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 546929b1810a4d20b273f3e5492ec6ed Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-TestMinimumBasicScenario-140635566 Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:28:39.765450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:28:39.768051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/546929b1810a4d20b273f3e5492ec6ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/546929b1810a4d20b273f3e5492ec6ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_546929b1810a4d20b273f3e5492ec6ed", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/546929b1810a4d20b273f3e5492ec6ed"}]}] Jun 16 17:28:39.768051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-TestMinimumBasicScenario-140635566 Jun 16 17:28:39.768051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 546929b1810a4d20b273f3e5492ec6ed Jun 16 17:28:39.768051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-TestMinimumBasicScenario-140635566 Jun 16 17:28:39.768051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-TestMinimumBasicScenario-140635566-project Jun 16 17:28:39.768051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:28:39.768051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:28:39.768051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 71df16d1e792468585702fd688b8d3f2 Jun 16 17:28:39.768051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-TestMinimumBasicScenario-140635566-project Jun 16 17:28:39.768051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:28:39.768051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 could not be found. Jun 16 17:28:39.768051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': 'b4ee9b10-f2da-442c-9475-3cfb21c9ad54'} Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 could not be found. Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:28:39.769393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 could not be found. Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 could not be found. Jun 16 17:28:39.771654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:28:39.775340 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a94a8a8a-6a2e-41ac-9e21-31228c95a881 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Returning 404 to user: Instance b4ee9b10-f2da-442c-9475-3cfb21c9ad54 could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:28:39.775340 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a94a8a8a-6a2e-41ac-9e21-31228c95a881 tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54" status: 404 len: 111 microversion: 2.1 time: 0.041173 Jun 16 17:28:39.777333 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 355/712] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:28:39 2022] GET /compute/v2.1/servers/b4ee9b10-f2da-442c-9475-3cfb21c9ad54 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:28:39.779730 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ff058056-670f-48ee-a649-35739dad4f5d tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] Calling method '.version_select at 0x7f66b15d7700>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:39.806576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ff058056-670f-48ee-a649-35739dad4f5d tempest-TestMinimumBasicScenario-140635566 tempest-TestMinimumBasicScenario-140635566-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-345635134" status: 202 len: 0 microversion: 2.1 time: 0.031260 Jun 16 17:28:39.806576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 358/713] 10.222.0.66 () {58 vars in 1268 bytes} [Thu Jun 16 17:28:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-345635134 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:28:46.522079 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-61d7ab06-3822-4310-b6e1-8699c697cfe5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:46.522814 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-61d7ab06-3822-4310-b6e1-8699c697cfe5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:46.533140 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-61d7ab06-3822-4310-b6e1-8699c697cfe5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:46.533997 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-61d7ab06-3822-4310-b6e1-8699c697cfe5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:46.535303 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-61d7ab06-3822-4310-b6e1-8699c697cfe5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:46.538614 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-61d7ab06-3822-4310-b6e1-8699c697cfe5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:46.569757 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-61d7ab06-3822-4310-b6e1-8699c697cfe5 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4/ips" status: 200 len: 150 microversion: 2.20 time: 0.055050 Jun 16 17:28:46.572256 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 356/714] 10.222.0.66 () {60 vars in 1288 bytes} [Thu Jun 16 17:28:46 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4/ips => generated 150 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:28:48.685639 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-eee18a50-b161-4ce5-bf0c-393854a84fc9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:28:48.687606 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-eee18a50-b161-4ce5-bf0c-393854a84fc9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:48.699951 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-eee18a50-b161-4ce5-bf0c-393854a84fc9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:48.700783 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-eee18a50-b161-4ce5-bf0c-393854a84fc9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:48.702309 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-eee18a50-b161-4ce5-bf0c-393854a84fc9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:48.703484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-eee18a50-b161-4ce5-bf0c-393854a84fc9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:48.758292 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.objects.instance [None req-eee18a50-b161-4ce5-bf0c-393854a84fc9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lazy-loading 'flavor' on Instance uuid a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 {{(pid=117553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:28:49.066093 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-eee18a50-b161-4ce5-bf0c-393854a84fc9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "POST /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4/action" status: 202 len: 0 microversion: 2.20 time: 0.388970 Jun 16 17:28:49.070717 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 359/715] 10.222.0.66 () {62 vars in 1318 bytes} [Thu Jun 16 17:28:48 2022] POST /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 17:28:49.076577 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-6309e570-55f2-4c04-84a5-ff30d05ee462 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:49.077311 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-6309e570-55f2-4c04-84a5-ff30d05ee462 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:49.086376 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6309e570-55f2-4c04-84a5-ff30d05ee462 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:49.086812 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6309e570-55f2-4c04-84a5-ff30d05ee462 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:49.087598 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6309e570-55f2-4c04-84a5-ff30d05ee462 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:49.088244 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6309e570-55f2-4c04-84a5-ff30d05ee462 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:49.268560 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-6309e570-55f2-4c04-84a5-ff30d05ee462 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:49.278640 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-6309e570-55f2-4c04-84a5-ff30d05ee462 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:49.280738 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-6309e570-55f2-4c04-84a5-ff30d05ee462 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:49.282169 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-6309e570-55f2-4c04-84a5-ff30d05ee462 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1723 microversion: 2.20 time: 0.209506 Jun 16 17:28:49.307564 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 357/716] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:28:49 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:28:50.318491 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-e9de78ed-3486-481a-bf3d-f082bd30be35 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:50.319194 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-e9de78ed-3486-481a-bf3d-f082bd30be35 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:50.326943 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e9de78ed-3486-481a-bf3d-f082bd30be35 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:50.327391 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e9de78ed-3486-481a-bf3d-f082bd30be35 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:50.328227 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e9de78ed-3486-481a-bf3d-f082bd30be35 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:50.328662 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e9de78ed-3486-481a-bf3d-f082bd30be35 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:50.478774 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e9de78ed-3486-481a-bf3d-f082bd30be35 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:50.488275 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e9de78ed-3486-481a-bf3d-f082bd30be35 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:50.490964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e9de78ed-3486-481a-bf3d-f082bd30be35 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:50.493501 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-e9de78ed-3486-481a-bf3d-f082bd30be35 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1723 microversion: 2.20 time: 0.178076 Jun 16 17:28:50.501256 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 360/717] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:28:50 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:28:51.511994 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5e1b9fda-c073-482d-b265-1cbcc5f1d4ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:51.513208 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-5e1b9fda-c073-482d-b265-1cbcc5f1d4ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:51.520108 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5e1b9fda-c073-482d-b265-1cbcc5f1d4ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:51.520833 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5e1b9fda-c073-482d-b265-1cbcc5f1d4ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:51.521859 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5e1b9fda-c073-482d-b265-1cbcc5f1d4ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:51.522289 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5e1b9fda-c073-482d-b265-1cbcc5f1d4ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:51.667476 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5e1b9fda-c073-482d-b265-1cbcc5f1d4ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:51.675588 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5e1b9fda-c073-482d-b265-1cbcc5f1d4ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:51.677068 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5e1b9fda-c073-482d-b265-1cbcc5f1d4ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:51.678452 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-5e1b9fda-c073-482d-b265-1cbcc5f1d4ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1723 microversion: 2.20 time: 0.170518 Jun 16 17:28:51.679032 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 358/718] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:28:51 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:28:52.696663 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-aece1500-2f48-46bf-bb71-35387ca1a34b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:52.697397 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-aece1500-2f48-46bf-bb71-35387ca1a34b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:52.704509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-aece1500-2f48-46bf-bb71-35387ca1a34b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:52.705025 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-aece1500-2f48-46bf-bb71-35387ca1a34b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:52.705882 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-aece1500-2f48-46bf-bb71-35387ca1a34b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:52.706379 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-aece1500-2f48-46bf-bb71-35387ca1a34b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:52.849298 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-aece1500-2f48-46bf-bb71-35387ca1a34b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:52.858147 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-aece1500-2f48-46bf-bb71-35387ca1a34b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:52.859633 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-aece1500-2f48-46bf-bb71-35387ca1a34b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:52.861089 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-aece1500-2f48-46bf-bb71-35387ca1a34b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1723 microversion: 2.20 time: 0.168162 Jun 16 17:28:52.861697 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 361/719] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:28:52 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:28:53.880311 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a793fded-b319-440b-af43-d4987379e54c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:53.880921 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a793fded-b319-440b-af43-d4987379e54c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:53.890360 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a793fded-b319-440b-af43-d4987379e54c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:53.891090 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a793fded-b319-440b-af43-d4987379e54c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:53.891945 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a793fded-b319-440b-af43-d4987379e54c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:53.892376 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a793fded-b319-440b-af43-d4987379e54c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:54.039075 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a793fded-b319-440b-af43-d4987379e54c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:54.047585 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a793fded-b319-440b-af43-d4987379e54c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:54.049060 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a793fded-b319-440b-af43-d4987379e54c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:54.050245 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a793fded-b319-440b-af43-d4987379e54c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1723 microversion: 2.20 time: 0.174013 Jun 16 17:28:54.050795 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 359/720] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:28:53 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:28:55.069205 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-15c0df04-0852-46f9-a339-6f40e6eecd1c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:55.070070 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-15c0df04-0852-46f9-a339-6f40e6eecd1c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:55.087751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-15c0df04-0852-46f9-a339-6f40e6eecd1c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:55.088189 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-15c0df04-0852-46f9-a339-6f40e6eecd1c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:55.089131 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-15c0df04-0852-46f9-a339-6f40e6eecd1c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:55.089586 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-15c0df04-0852-46f9-a339-6f40e6eecd1c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:55.236881 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-15c0df04-0852-46f9-a339-6f40e6eecd1c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:55.245663 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-15c0df04-0852-46f9-a339-6f40e6eecd1c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:55.247128 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-15c0df04-0852-46f9-a339-6f40e6eecd1c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:55.248297 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-15c0df04-0852-46f9-a339-6f40e6eecd1c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1723 microversion: 2.20 time: 0.183810 Jun 16 17:28:55.248856 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 362/721] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:28:55 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:28:56.266535 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-da438e2d-2a7b-47e6-851c-46472e9efd89 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:56.267303 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-da438e2d-2a7b-47e6-851c-46472e9efd89 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:56.274484 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-da438e2d-2a7b-47e6-851c-46472e9efd89 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:56.274934 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-da438e2d-2a7b-47e6-851c-46472e9efd89 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:56.275786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-da438e2d-2a7b-47e6-851c-46472e9efd89 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:56.276128 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-da438e2d-2a7b-47e6-851c-46472e9efd89 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:56.423330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-da438e2d-2a7b-47e6-851c-46472e9efd89 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:56.433757 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-da438e2d-2a7b-47e6-851c-46472e9efd89 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:56.435422 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-da438e2d-2a7b-47e6-851c-46472e9efd89 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:56.436967 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-da438e2d-2a7b-47e6-851c-46472e9efd89 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1723 microversion: 2.20 time: 0.174267 Jun 16 17:28:56.437583 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 360/722] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:28:56 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:28:57.458505 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ea4ea344-192d-44c0-834a-d43dc11dd754 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:57.459258 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ea4ea344-192d-44c0-834a-d43dc11dd754 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:57.466936 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ea4ea344-192d-44c0-834a-d43dc11dd754 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:57.467358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ea4ea344-192d-44c0-834a-d43dc11dd754 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:57.468519 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ea4ea344-192d-44c0-834a-d43dc11dd754 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:57.476988 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ea4ea344-192d-44c0-834a-d43dc11dd754 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:57.667456 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ea4ea344-192d-44c0-834a-d43dc11dd754 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:57.675873 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ea4ea344-192d-44c0-834a-d43dc11dd754 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:57.677682 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ea4ea344-192d-44c0-834a-d43dc11dd754 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:57.678963 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ea4ea344-192d-44c0-834a-d43dc11dd754 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1723 microversion: 2.20 time: 0.224595 Jun 16 17:28:57.679497 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 363/723] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:28:57 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:28:58.697824 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-95d8d718-6888-46b3-8336-d92e5552bba9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:58.698410 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-95d8d718-6888-46b3-8336-d92e5552bba9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:58.705968 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-95d8d718-6888-46b3-8336-d92e5552bba9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:58.706413 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-95d8d718-6888-46b3-8336-d92e5552bba9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:58.707268 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-95d8d718-6888-46b3-8336-d92e5552bba9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:58.707698 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-95d8d718-6888-46b3-8336-d92e5552bba9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:58.871379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-95d8d718-6888-46b3-8336-d92e5552bba9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:58.881582 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-95d8d718-6888-46b3-8336-d92e5552bba9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:58.883344 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-95d8d718-6888-46b3-8336-d92e5552bba9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:28:58.884574 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-95d8d718-6888-46b3-8336-d92e5552bba9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1723 microversion: 2.20 time: 0.191124 Jun 16 17:28:58.885440 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 361/724] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:28:58 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:28:59.903633 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-3b4bfcaf-eadd-4f43-9f94-026c30371565 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:59.904208 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-3b4bfcaf-eadd-4f43-9f94-026c30371565 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:28:59.912616 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3b4bfcaf-eadd-4f43-9f94-026c30371565 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:59.913067 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3b4bfcaf-eadd-4f43-9f94-026c30371565 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:28:59.913876 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3b4bfcaf-eadd-4f43-9f94-026c30371565 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:28:59.914315 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3b4bfcaf-eadd-4f43-9f94-026c30371565 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:00.068699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-3b4bfcaf-eadd-4f43-9f94-026c30371565 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:00.081157 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-3b4bfcaf-eadd-4f43-9f94-026c30371565 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:00.082752 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-3b4bfcaf-eadd-4f43-9f94-026c30371565 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:00.084745 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-3b4bfcaf-eadd-4f43-9f94-026c30371565 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1723 microversion: 2.20 time: 0.184358 Jun 16 17:29:00.089667 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 364/725] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:28:59 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:01.105085 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-81809b01-c5bf-4e57-84da-76aa0c813124 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:01.105731 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-81809b01-c5bf-4e57-84da-76aa0c813124 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:01.115757 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-81809b01-c5bf-4e57-84da-76aa0c813124 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:01.116317 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-81809b01-c5bf-4e57-84da-76aa0c813124 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:01.117220 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-81809b01-c5bf-4e57-84da-76aa0c813124 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:01.117735 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-81809b01-c5bf-4e57-84da-76aa0c813124 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:01.283899 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-81809b01-c5bf-4e57-84da-76aa0c813124 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:01.294566 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-81809b01-c5bf-4e57-84da-76aa0c813124 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:01.296195 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-81809b01-c5bf-4e57-84da-76aa0c813124 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:01.297777 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-81809b01-c5bf-4e57-84da-76aa0c813124 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1723 microversion: 2.20 time: 0.198027 Jun 16 17:29:01.298333 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 362/726] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:01 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:02.318288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-87d0906c-3f5f-43b2-959c-b393eda6d8d4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:02.319094 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-87d0906c-3f5f-43b2-959c-b393eda6d8d4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:02.325515 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-87d0906c-3f5f-43b2-959c-b393eda6d8d4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:02.325990 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-87d0906c-3f5f-43b2-959c-b393eda6d8d4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:02.326752 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-87d0906c-3f5f-43b2-959c-b393eda6d8d4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:02.327158 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-87d0906c-3f5f-43b2-959c-b393eda6d8d4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:02.331616 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:02.702735 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-87d0906c-3f5f-43b2-959c-b393eda6d8d4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:02.711254 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-87d0906c-3f5f-43b2-959c-b393eda6d8d4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:02.712858 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-87d0906c-3f5f-43b2-959c-b393eda6d8d4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:02.714052 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-87d0906c-3f5f-43b2-959c-b393eda6d8d4 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1723 microversion: 2.20 time: 0.400541 Jun 16 17:29:02.714599 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 365/727] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:02 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1723 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:03.732586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-4aecd285-0be9-46c9-9725-9b112996feac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:03.733235 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-4aecd285-0be9-46c9-9725-9b112996feac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:03.737241 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=29 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:03.741545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4aecd285-0be9-46c9-9725-9b112996feac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:03.741988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4aecd285-0be9-46c9-9725-9b112996feac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:03.742749 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4aecd285-0be9-46c9-9725-9b112996feac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:03.743175 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4aecd285-0be9-46c9-9725-9b112996feac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:03.747654 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:03.886819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-4aecd285-0be9-46c9-9725-9b112996feac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:03.897660 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-4aecd285-0be9-46c9-9725-9b112996feac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:03.899401 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-4aecd285-0be9-46c9-9725-9b112996feac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:03.900742 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-4aecd285-0be9-46c9-9725-9b112996feac tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1723 microversion: 2.20 time: 0.172314 Jun 16 17:29:03.901667 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 363/728] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:03 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:04.587283 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5d3550e0-ecf4-4a7e-8fa0-67cf9cd931aa tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:04.587856 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5d3550e0-ecf4-4a7e-8fa0-67cf9cd931aa tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:04.590291 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:04.595921 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5d3550e0-ecf4-4a7e-8fa0-67cf9cd931aa tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:04.596344 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5d3550e0-ecf4-4a7e-8fa0-67cf9cd931aa tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:04.597356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5d3550e0-ecf4-4a7e-8fa0-67cf9cd931aa tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:04.597790 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5d3550e0-ecf4-4a7e-8fa0-67cf9cd931aa tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:04.625380 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5d3550e0-ecf4-4a7e-8fa0-67cf9cd931aa tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/ips" status: 200 len: 146 microversion: 2.1 time: 0.043021 Jun 16 17:29:04.625955 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 366/729] 10.222.0.66 () {58 vars in 1247 bytes} [Thu Jun 16 17:29:04 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:29:04.920810 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c51c672d-c6bb-499c-ae2e-edcbc19c273b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:04.921578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c51c672d-c6bb-499c-ae2e-edcbc19c273b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:04.930945 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c51c672d-c6bb-499c-ae2e-edcbc19c273b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:04.931713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c51c672d-c6bb-499c-ae2e-edcbc19c273b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:04.933370 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c51c672d-c6bb-499c-ae2e-edcbc19c273b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:04.934559 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c51c672d-c6bb-499c-ae2e-edcbc19c273b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:05.121227 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c51c672d-c6bb-499c-ae2e-edcbc19c273b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:05.138704 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c51c672d-c6bb-499c-ae2e-edcbc19c273b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:05.143994 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c51c672d-c6bb-499c-ae2e-edcbc19c273b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:05.146748 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c51c672d-c6bb-499c-ae2e-edcbc19c273b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1744 microversion: 2.20 time: 0.230243 Jun 16 17:29:05.147346 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 364/730] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:04 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1744 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:06.025233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8ca08230-b931-4df7-984c-c3b603652740 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ce28b8a-4df1-4b27-8a2c-978f116c6151"}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:29:06.026903 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-8ca08230-b931-4df7-984c-c3b603652740 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:06.038210 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8ca08230-b931-4df7-984c-c3b603652740 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:06.039007 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8ca08230-b931-4df7-984c-c3b603652740 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:06.040290 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8ca08230-b931-4df7-984c-c3b603652740 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:06.041013 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8ca08230-b931-4df7-984c-c3b603652740 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:06.174095 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e2f522de-813a-4e8a-806e-a59b9537dc6a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:06.174814 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e2f522de-813a-4e8a-806e-a59b9537dc6a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:06.182940 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e2f522de-813a-4e8a-806e-a59b9537dc6a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:06.183498 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e2f522de-813a-4e8a-806e-a59b9537dc6a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:06.184350 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e2f522de-813a-4e8a-806e-a59b9537dc6a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:06.184928 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e2f522de-813a-4e8a-806e-a59b9537dc6a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:06.343455 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-e2f522de-813a-4e8a-806e-a59b9537dc6a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:06.346328 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8ca08230-b931-4df7-984c-c3b603652740 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "POST /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330045 Jun 16 17:29:06.347237 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 367/731] 10.222.0.66 () {60 vars in 1322 bytes} [Thu Jun 16 17:29:06 2022] POST /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:29:06.353771 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-e2f522de-813a-4e8a-806e-a59b9537dc6a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:06.356080 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-e2f522de-813a-4e8a-806e-a59b9537dc6a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:06.357919 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-e2f522de-813a-4e8a-806e-a59b9537dc6a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1744 microversion: 2.20 time: 0.188075 Jun 16 17:29:06.359738 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 365/732] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:06 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1744 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:29:07.052995 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-95e2e912-a50c-4bfd-b005-fe635600832d req-847cc7ac-d7fe-4d83-91d4-14448566ef83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4", "name": "network-vif-plugged", "status": "completed", "tag": "8d7a682c-8735-4554-a952-dc548868e5d9"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:29:07.065739 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-95e2e912-a50c-4bfd-b005-fe635600832d req-847cc7ac-d7fe-4d83-91d4-14448566ef83 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:07.066499 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-95e2e912-a50c-4bfd-b005-fe635600832d req-847cc7ac-d7fe-4d83-91d4-14448566ef83 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:07.084370 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-95e2e912-a50c-4bfd-b005-fe635600832d req-847cc7ac-d7fe-4d83-91d4-14448566ef83 service nova] Creating event network-vif-plugged:8d7a682c-8735-4554-a952-dc548868e5d9 for instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 on hv-cinder-83735 Jun 16 17:29:07.091747 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-95e2e912-a50c-4bfd-b005-fe635600832d req-847cc7ac-d7fe-4d83-91d4-14448566ef83 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206516 Jun 16 17:29:07.093051 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 368/733] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:29:07.384937 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-806f6cd4-199f-4f3c-9b8d-c57586af7d4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:07.386894 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-806f6cd4-199f-4f3c-9b8d-c57586af7d4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:07.395757 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-806f6cd4-199f-4f3c-9b8d-c57586af7d4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:07.396794 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-806f6cd4-199f-4f3c-9b8d-c57586af7d4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:07.397548 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-806f6cd4-199f-4f3c-9b8d-c57586af7d4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:07.397978 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-806f6cd4-199f-4f3c-9b8d-c57586af7d4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:07.618598 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-806f6cd4-199f-4f3c-9b8d-c57586af7d4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:07.630302 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-806f6cd4-199f-4f3c-9b8d-c57586af7d4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:07.632885 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-806f6cd4-199f-4f3c-9b8d-c57586af7d4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:07.634348 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-806f6cd4-199f-4f3c-9b8d-c57586af7d4a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1739 microversion: 2.20 time: 0.254560 Jun 16 17:29:07.635261 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 366/734] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:07 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:08.654072 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8fb96ec4-a02f-4f79-9320-c954c69dd85a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:08.655392 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-8fb96ec4-a02f-4f79-9320-c954c69dd85a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:08.662864 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8fb96ec4-a02f-4f79-9320-c954c69dd85a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:08.663311 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8fb96ec4-a02f-4f79-9320-c954c69dd85a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:08.664086 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8fb96ec4-a02f-4f79-9320-c954c69dd85a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:08.664522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8fb96ec4-a02f-4f79-9320-c954c69dd85a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:08.819494 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8fb96ec4-a02f-4f79-9320-c954c69dd85a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:08.829254 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8fb96ec4-a02f-4f79-9320-c954c69dd85a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:08.834435 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8fb96ec4-a02f-4f79-9320-c954c69dd85a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:08.835883 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8fb96ec4-a02f-4f79-9320-c954c69dd85a tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1739 microversion: 2.20 time: 0.186666 Jun 16 17:29:08.836899 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 369/735] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:08 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:09.855463 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7f10d7bd-f274-4d90-83a6-e99fac68b84f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:09.856064 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7f10d7bd-f274-4d90-83a6-e99fac68b84f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:09.872595 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7f10d7bd-f274-4d90-83a6-e99fac68b84f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:09.873463 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7f10d7bd-f274-4d90-83a6-e99fac68b84f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:09.874230 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7f10d7bd-f274-4d90-83a6-e99fac68b84f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:09.875052 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7f10d7bd-f274-4d90-83a6-e99fac68b84f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:10.045167 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7f10d7bd-f274-4d90-83a6-e99fac68b84f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:10.055663 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7f10d7bd-f274-4d90-83a6-e99fac68b84f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:10.056983 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7f10d7bd-f274-4d90-83a6-e99fac68b84f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:10.058389 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7f10d7bd-f274-4d90-83a6-e99fac68b84f tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1739 microversion: 2.20 time: 0.207385 Jun 16 17:29:10.070885 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 367/736] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:09 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:11.077626 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-bcca542f-2ac9-4574-896c-2a73674ce5ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:11.078828 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-bcca542f-2ac9-4574-896c-2a73674ce5ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:11.086294 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bcca542f-2ac9-4574-896c-2a73674ce5ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:11.087029 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bcca542f-2ac9-4574-896c-2a73674ce5ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:11.088031 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bcca542f-2ac9-4574-896c-2a73674ce5ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:11.088423 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bcca542f-2ac9-4574-896c-2a73674ce5ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:11.275108 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-bcca542f-2ac9-4574-896c-2a73674ce5ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:11.290639 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-bcca542f-2ac9-4574-896c-2a73674ce5ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:11.292908 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-bcca542f-2ac9-4574-896c-2a73674ce5ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:11.296870 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-bcca542f-2ac9-4574-896c-2a73674ce5ce tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1739 microversion: 2.20 time: 0.222336 Jun 16 17:29:11.298717 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 370/737] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:11 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:12.321331 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-bea29fb5-b869-4332-97de-0e76de657635 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:12.322129 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-bea29fb5-b869-4332-97de-0e76de657635 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:12.331988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bea29fb5-b869-4332-97de-0e76de657635 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:12.333080 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bea29fb5-b869-4332-97de-0e76de657635 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:12.335167 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bea29fb5-b869-4332-97de-0e76de657635 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:12.336346 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bea29fb5-b869-4332-97de-0e76de657635 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:12.537594 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-bea29fb5-b869-4332-97de-0e76de657635 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:12.551046 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-bea29fb5-b869-4332-97de-0e76de657635 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:12.553857 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-bea29fb5-b869-4332-97de-0e76de657635 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:12.555631 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-bea29fb5-b869-4332-97de-0e76de657635 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1739 microversion: 2.20 time: 0.239292 Jun 16 17:29:12.556439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 368/738] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:12 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:13.062639 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-79f568de-0292-43b2-9b71-8b88aa4ab2b1 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:13.064515 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-79f568de-0292-43b2-9b71-8b88aa4ab2b1 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:13.073549 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-79f568de-0292-43b2-9b71-8b88aa4ab2b1 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:13.074071 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-79f568de-0292-43b2-9b71-8b88aa4ab2b1 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:13.074925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-79f568de-0292-43b2-9b71-8b88aa4ab2b1 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:13.075427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-79f568de-0292-43b2-9b71-8b88aa4ab2b1 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:13.126140 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-79f568de-0292-43b2-9b71-8b88aa4ab2b1 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067287 Jun 16 17:29:13.127063 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 371/739] 10.222.0.66 () {58 vars in 1301 bytes} [Thu Jun 16 17:29:13 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:29:13.142535 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-41ffc67c-bf6d-4b32-b10f-772de0251258 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:13.143256 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-41ffc67c-bf6d-4b32-b10f-772de0251258 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:13.152623 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-41ffc67c-bf6d-4b32-b10f-772de0251258 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:13.153300 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-41ffc67c-bf6d-4b32-b10f-772de0251258 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:13.154430 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-41ffc67c-bf6d-4b32-b10f-772de0251258 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:13.155060 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-41ffc67c-bf6d-4b32-b10f-772de0251258 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:13.191447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-41ffc67c-bf6d-4b32-b10f-772de0251258 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments/2ce28b8a-4df1-4b27-8a2c-978f116c6151" status: 200 len: 194 microversion: 2.1 time: 0.055367 Jun 16 17:29:13.192069 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 369/740] 10.222.0.66 () {58 vars in 1412 bytes} [Thu Jun 16 17:29:13 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments/2ce28b8a-4df1-4b27-8a2c-978f116c6151 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:29:13.579847 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-88cdb0dc-b44f-49f9-bd2a-d036b7540f46 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:13.580470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-88cdb0dc-b44f-49f9-bd2a-d036b7540f46 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:13.587459 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-88cdb0dc-b44f-49f9-bd2a-d036b7540f46 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:13.588249 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-88cdb0dc-b44f-49f9-bd2a-d036b7540f46 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:13.589273 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-88cdb0dc-b44f-49f9-bd2a-d036b7540f46 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:13.589872 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-88cdb0dc-b44f-49f9-bd2a-d036b7540f46 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:13.785503 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-88cdb0dc-b44f-49f9-bd2a-d036b7540f46 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:13.800412 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-88cdb0dc-b44f-49f9-bd2a-d036b7540f46 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:13.803601 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-88cdb0dc-b44f-49f9-bd2a-d036b7540f46 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:13.806313 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-88cdb0dc-b44f-49f9-bd2a-d036b7540f46 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1739 microversion: 2.20 time: 0.230074 Jun 16 17:29:13.814496 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 372/741] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:13 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:13.870248 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b2bde247-e4c7-403f-8fad-310077022bfd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:13.871525 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b2bde247-e4c7-403f-8fad-310077022bfd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:13.878865 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b2bde247-e4c7-403f-8fad-310077022bfd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:13.879921 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b2bde247-e4c7-403f-8fad-310077022bfd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:13.880801 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b2bde247-e4c7-403f-8fad-310077022bfd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:13.881613 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b2bde247-e4c7-403f-8fad-310077022bfd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:13.910144 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b2bde247-e4c7-403f-8fad-310077022bfd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Going to try to terminate instance {{(pid=117552) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:29:14.013926 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b2bde247-e4c7-403f-8fad-310077022bfd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "DELETE /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 204 len: 0 microversion: 2.1 time: 0.148123 Jun 16 17:29:14.022320 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 370/742] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:29:13 2022] DELETE /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:29:14.027883 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d427ad56-c309-40d3-8d13-83f731e861cd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:14.028798 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-d427ad56-c309-40d3-8d13-83f731e861cd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:14.036707 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d427ad56-c309-40d3-8d13-83f731e861cd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:14.037335 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d427ad56-c309-40d3-8d13-83f731e861cd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:14.038131 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d427ad56-c309-40d3-8d13-83f731e861cd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:14.038564 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d427ad56-c309-40d3-8d13-83f731e861cd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:14.275761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d427ad56-c309-40d3-8d13-83f731e861cd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:14.291001 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-d427ad56-c309-40d3-8d13-83f731e861cd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1579 microversion: 2.1 time: 0.267282 Jun 16 17:29:14.296095 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 373/743] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:14 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1579 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:14.706652 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-fbe5df1b-73a7-474e-a428-c9cee53767d8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b32716a1-c164-41cb-9fe4-dab222440732"}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:29:14.708630 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-fbe5df1b-73a7-474e-a428-c9cee53767d8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:14.717942 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fbe5df1b-73a7-474e-a428-c9cee53767d8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:14.718790 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fbe5df1b-73a7-474e-a428-c9cee53767d8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:14.719849 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fbe5df1b-73a7-474e-a428-c9cee53767d8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:14.720342 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fbe5df1b-73a7-474e-a428-c9cee53767d8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:14.826141 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d6483fd0-e1a4-49e2-8657-539808cba948 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:14.827102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-d6483fd0-e1a4-49e2-8657-539808cba948 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:14.834715 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d6483fd0-e1a4-49e2-8657-539808cba948 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:14.835173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d6483fd0-e1a4-49e2-8657-539808cba948 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:14.835988 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d6483fd0-e1a4-49e2-8657-539808cba948 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:14.836421 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d6483fd0-e1a4-49e2-8657-539808cba948 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:15.007756 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d6483fd0-e1a4-49e2-8657-539808cba948 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:15.017521 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d6483fd0-e1a4-49e2-8657-539808cba948 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:15.019478 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d6483fd0-e1a4-49e2-8657-539808cba948 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:15.021209 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-d6483fd0-e1a4-49e2-8657-539808cba948 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1739 microversion: 2.20 time: 0.198930 Jun 16 17:29:15.033020 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 374/744] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:14 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:29:15.314175 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-861c0be2-8803-4094-9771-c70adb8d9420 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:15.314964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-861c0be2-8803-4094-9771-c70adb8d9420 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:15.324717 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-861c0be2-8803-4094-9771-c70adb8d9420 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:15.325367 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-861c0be2-8803-4094-9771-c70adb8d9420 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:15.326580 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-861c0be2-8803-4094-9771-c70adb8d9420 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:15.327355 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-861c0be2-8803-4094-9771-c70adb8d9420 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:15.392831 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-fbe5df1b-73a7-474e-a428-c9cee53767d8 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "POST /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.693417 Jun 16 17:29:15.396766 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 371/745] 10.222.0.66 () {60 vars in 1322 bytes} [Thu Jun 16 17:29:14 2022] POST /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments => generated 194 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:29:15.618363 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-861c0be2-8803-4094-9771-c70adb8d9420 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:15.661427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-861c0be2-8803-4094-9771-c70adb8d9420 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1579 microversion: 2.1 time: 0.349593 Jun 16 17:29:15.662421 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 375/746] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:15 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1579 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:16.050365 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9138abc8-3e97-4e6a-8269-d2a9a222ef98 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:16.057934 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-9138abc8-3e97-4e6a-8269-d2a9a222ef98 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:16.073760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9138abc8-3e97-4e6a-8269-d2a9a222ef98 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:16.077804 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9138abc8-3e97-4e6a-8269-d2a9a222ef98 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:16.079109 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9138abc8-3e97-4e6a-8269-d2a9a222ef98 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:16.080854 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9138abc8-3e97-4e6a-8269-d2a9a222ef98 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:16.464090 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9138abc8-3e97-4e6a-8269-d2a9a222ef98 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:16.480334 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9138abc8-3e97-4e6a-8269-d2a9a222ef98 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:16.482551 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9138abc8-3e97-4e6a-8269-d2a9a222ef98 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:16.484335 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9138abc8-3e97-4e6a-8269-d2a9a222ef98 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1739 microversion: 2.20 time: 0.448691 Jun 16 17:29:16.502775 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 372/747] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:16 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1739 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:16.692283 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-0afc125a-c7ab-4e35-b90d-e5c145646ceb tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:16.693204 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-0afc125a-c7ab-4e35-b90d-e5c145646ceb tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:16.706411 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0afc125a-c7ab-4e35-b90d-e5c145646ceb tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:16.706865 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0afc125a-c7ab-4e35-b90d-e5c145646ceb tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:16.707738 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0afc125a-c7ab-4e35-b90d-e5c145646ceb tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:16.708325 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0afc125a-c7ab-4e35-b90d-e5c145646ceb tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:16.809284 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0afc125a-c7ab-4e35-b90d-e5c145646ceb tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:16.827351 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-0afc125a-c7ab-4e35-b90d-e5c145646ceb tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1512 microversion: 2.1 time: 0.146964 Jun 16 17:29:16.828377 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 376/748] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:16 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:17.089017 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-cece5198-86dc-4c93-9e2f-972267c59147 req-d4e7b93a-7f53-4ff9-874f-b0d96f7671b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157a0c77-c88e-4ef0-aef5-6ba851b57d00", "name": "network-vif-deleted", "tag": "0fdde9ef-e61f-4c66-9976-8477640c42a6"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:29:17.098154 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-cece5198-86dc-4c93-9e2f-972267c59147 req-d4e7b93a-7f53-4ff9-874f-b0d96f7671b5 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:17.098958 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-cece5198-86dc-4c93-9e2f-972267c59147 req-d4e7b93a-7f53-4ff9-874f-b0d96f7671b5 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:17.120364 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-cece5198-86dc-4c93-9e2f-972267c59147 req-d4e7b93a-7f53-4ff9-874f-b0d96f7671b5 service nova] Creating event network-vif-deleted:0fdde9ef-e61f-4c66-9976-8477640c42a6 for instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 on hv-cinder-83735 Jun 16 17:29:17.128104 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-cece5198-86dc-4c93-9e2f-972267c59147 req-d4e7b93a-7f53-4ff9-874f-b0d96f7671b5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042938 Jun 16 17:29:17.129005 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 373/749] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:29:17.502995 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ee399ddb-cc26-4163-a3db-c686e464c929 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:17.506281 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ee399ddb-cc26-4163-a3db-c686e464c929 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:17.519785 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ee399ddb-cc26-4163-a3db-c686e464c929 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:17.520461 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ee399ddb-cc26-4163-a3db-c686e464c929 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:17.521548 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ee399ddb-cc26-4163-a3db-c686e464c929 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:17.523073 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ee399ddb-cc26-4163-a3db-c686e464c929 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:17.754229 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ee399ddb-cc26-4163-a3db-c686e464c929 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:17.786402 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ee399ddb-cc26-4163-a3db-c686e464c929 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:17.789737 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ee399ddb-cc26-4163-a3db-c686e464c929 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:17.792224 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ee399ddb-cc26-4163-a3db-c686e464c929 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1739 microversion: 2.20 time: 0.292961 Jun 16 17:29:17.807242 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 377/750] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:17 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:17.851592 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b4e6e5e7-5634-41b5-a439-af457eb77394 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:17.853630 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b4e6e5e7-5634-41b5-a439-af457eb77394 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:17.870358 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b4e6e5e7-5634-41b5-a439-af457eb77394 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:17.872295 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b4e6e5e7-5634-41b5-a439-af457eb77394 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:17.873561 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b4e6e5e7-5634-41b5-a439-af457eb77394 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:17.874280 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b4e6e5e7-5634-41b5-a439-af457eb77394 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:17.946660 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b4e6e5e7-5634-41b5-a439-af457eb77394 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:17.947450 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b4e6e5e7-5634-41b5-a439-af457eb77394 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:17.947930 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.objects.instance [None req-b4e6e5e7-5634-41b5-a439-af457eb77394 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lazy-loading 'fault' on Instance uuid 157a0c77-c88e-4ef0-aef5-6ba851b57d00 {{(pid=117552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:29:18.057300 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-b4e6e5e7-5634-41b5-a439-af457eb77394 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:18.069087 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b4e6e5e7-5634-41b5-a439-af457eb77394 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 200 len: 1185 microversion: 2.1 time: 0.226341 Jun 16 17:29:18.070954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 374/751] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:17 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 1185 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:18.812266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5359c2dc-d70d-4193-af58-4cb40a54e62e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:18.812878 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5359c2dc-d70d-4193-af58-4cb40a54e62e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:18.820317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5359c2dc-d70d-4193-af58-4cb40a54e62e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:18.820764 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5359c2dc-d70d-4193-af58-4cb40a54e62e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:18.821591 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5359c2dc-d70d-4193-af58-4cb40a54e62e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:18.822027 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5359c2dc-d70d-4193-af58-4cb40a54e62e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:19.049874 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-5359c2dc-d70d-4193-af58-4cb40a54e62e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:19.059702 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-5359c2dc-d70d-4193-af58-4cb40a54e62e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:19.061320 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-5359c2dc-d70d-4193-af58-4cb40a54e62e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:19.062538 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5359c2dc-d70d-4193-af58-4cb40a54e62e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1721 microversion: 2.20 time: 0.254618 Jun 16 17:29:19.063102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 378/752] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:18 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:19.087551 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5c4d82ad-7c43-433a-aff0-fc3749043cb3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:19.088222 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-5c4d82ad-7c43-433a-aff0-fc3749043cb3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:19.094986 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5c4d82ad-7c43-433a-aff0-fc3749043cb3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:19.095423 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5c4d82ad-7c43-433a-aff0-fc3749043cb3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:19.096197 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5c4d82ad-7c43-433a-aff0-fc3749043cb3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:19.096613 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5c4d82ad-7c43-433a-aff0-fc3749043cb3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:19.113553 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-5c4d82ad-7c43-433a-aff0-fc3749043cb3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] HTTP exception thrown: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5c4d82ad-7c43-433a-aff0-fc3749043cb3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Request method failure captured: Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 HTTP/1.1 Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2eFw6_U-ptmuweRKQwrW58d8B_3CgkZ165Jfz1FqCqwUodyV2kbBrfqufcZQUb2LLHllv0IvNEBSlfLrr31_0IlR8cbqRDs3hkA3KBNBR8SlLmCIRmf5gpJIYcsenQ27PlY5_NKbhJUEv4c_6cPSe4ryXG8zIcWdp6KYXNkC1rGups Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: bd1488226a424c6e9e7f94f31b020e4f Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-TestVolumeBootPattern-1350759327 Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:29:19.115545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:29:19.117217 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bd1488226a424c6e9e7f94f31b020e4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bd1488226a424c6e9e7f94f31b020e4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bd1488226a424c6e9e7f94f31b020e4f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bd1488226a424c6e9e7f94f31b020e4f"}]}] Jun 16 17:29:19.117217 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-TestVolumeBootPattern-1350759327 Jun 16 17:29:19.117217 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: bd1488226a424c6e9e7f94f31b020e4f Jun 16 17:29:19.117217 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-TestVolumeBootPattern-1350759327 Jun 16 17:29:19.117217 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-TestVolumeBootPattern-1350759327-project Jun 16 17:29:19.117217 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:29:19.117217 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:29:19.117217 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: fbbafeb56a4d4fd282275e4198ede783 Jun 16 17:29:19.117217 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-TestVolumeBootPattern-1350759327-project Jun 16 17:29:19.117217 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:29:19.117217 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. Jun 16 17:29:19.117217 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': '157a0c77-c88e-4ef0-aef5-6ba851b57d00'} Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:29:19.118980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. Jun 16 17:29:19.120662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:29:19.122825 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5c4d82ad-7c43-433a-aff0-fc3749043cb3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Returning 404 to user: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:29:19.122825 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-5c4d82ad-7c43-433a-aff0-fc3749043cb3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 404 len: 111 microversion: 2.1 time: 0.033579 Jun 16 17:29:19.122825 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 375/753] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:19 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:29:19.242771 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-cb3248a5-5cf4-4bd2-926a-7ea1f76a596f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1144767147", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2110136853", "security_groups": [{"name": "tempest-secgroup-smoke-641343783"}], "block_device_mapping_v2": [{"uuid": "a0b4308e-b64d-4831-88b8-b801d3610548", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3da1c24e-a853-4091-89c9-dc663f379476"}]}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:29:19.585098 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.network.neutron [None req-cb3248a5-5cf4-4bd2-926a-7ea1f76a596f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] validate_networks() for [('3da1c24e-a853-4091-89c9-dc663f379476', None, None, None, None, None)] {{(pid=117553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:29:20.054692 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-cb3248a5-5cf4-4bd2-926a-7ea1f76a596f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Flavor limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:29:20.055318 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-cb3248a5-5cf4-4bd2-926a-7ea1f76a596f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Image limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:29:20.055759 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-cb3248a5-5cf4-4bd2-926a-7ea1f76a596f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Flavor pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:29:20.056228 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-cb3248a5-5cf4-4bd2-926a-7ea1f76a596f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Image pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:29:20.056722 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-cb3248a5-5cf4-4bd2-926a-7ea1f76a596f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:29:20.066382 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cb3248a5-5cf4-4bd2-926a-7ea1f76a596f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:20.066741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cb3248a5-5cf4-4bd2-926a-7ea1f76a596f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:20.067595 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cb3248a5-5cf4-4bd2-926a-7ea1f76a596f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:20.068674 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cb3248a5-5cf4-4bd2-926a-7ea1f76a596f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:20.084668 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-94913cea-bd57-43d7-9274-aa9f98c16ac1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:20.085623 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-94913cea-bd57-43d7-9274-aa9f98c16ac1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:20.086267 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-cb3248a5-5cf4-4bd2-926a-7ea1f76a596f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Getting quotas for project bd1488226a424c6e9e7f94f31b020e4f. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:29:20.090758 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-cb3248a5-5cf4-4bd2-926a-7ea1f76a596f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Getting quotas for user fbbafeb56a4d4fd282275e4198ede783 and project bd1488226a424c6e9e7f94f31b020e4f. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:29:20.092432 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-94913cea-bd57-43d7-9274-aa9f98c16ac1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:20.093460 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-94913cea-bd57-43d7-9274-aa9f98c16ac1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:20.094431 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-94913cea-bd57-43d7-9274-aa9f98c16ac1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:20.095013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-94913cea-bd57-43d7-9274-aa9f98c16ac1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:20.159630 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-cb3248a5-5cf4-4bd2-926a-7ea1f76a596f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Going to run 1 instances... {{(pid=117553) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:29:20.162715 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-cb3248a5-5cf4-4bd2-926a-7ea1f76a596f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a0b4308e-b64d-4831-88b8-b801d3610548',volume_size=None,volume_type=None)] {{(pid=117553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:29:20.259966 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-94913cea-bd57-43d7-9274-aa9f98c16ac1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:20.269915 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-94913cea-bd57-43d7-9274-aa9f98c16ac1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:20.271637 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-94913cea-bd57-43d7-9274-aa9f98c16ac1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:20.273123 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-94913cea-bd57-43d7-9274-aa9f98c16ac1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1721 microversion: 2.20 time: 0.194698 Jun 16 17:29:20.274044 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 376/754] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:20 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:20.315686 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-cb3248a5-5cf4-4bd2-926a-7ea1f76a596f tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.077712 Jun 16 17:29:20.316324 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 379/755] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:29:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:29:20.327651 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ef4dd3f6-4a19-49c2-9d00-b6aeeb25d157 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:20.328171 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ef4dd3f6-4a19-49c2-9d00-b6aeeb25d157 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:20.389920 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ef4dd3f6-4a19-49c2-9d00-b6aeeb25d157 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:20.397254 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ef4dd3f6-4a19-49c2-9d00-b6aeeb25d157 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1095 microversion: 2.1 time: 0.073996 Jun 16 17:29:20.398063 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 377/756] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:20 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:21.291866 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4099a7b6-8133-44ab-9efd-865c64f496c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:21.292478 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4099a7b6-8133-44ab-9efd-865c64f496c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:21.300468 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4099a7b6-8133-44ab-9efd-865c64f496c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:21.302659 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4099a7b6-8133-44ab-9efd-865c64f496c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:21.302659 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4099a7b6-8133-44ab-9efd-865c64f496c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:21.302659 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4099a7b6-8133-44ab-9efd-865c64f496c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:21.415621 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-fe4e6c4f-54d3-4dff-bbab-aa5917c204c5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:21.416223 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-fe4e6c4f-54d3-4dff-bbab-aa5917c204c5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:21.423970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fe4e6c4f-54d3-4dff-bbab-aa5917c204c5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:21.425716 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fe4e6c4f-54d3-4dff-bbab-aa5917c204c5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:21.426786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fe4e6c4f-54d3-4dff-bbab-aa5917c204c5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:21.427273 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fe4e6c4f-54d3-4dff-bbab-aa5917c204c5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:21.452809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4099a7b6-8133-44ab-9efd-865c64f496c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:21.462224 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4099a7b6-8133-44ab-9efd-865c64f496c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:21.463705 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4099a7b6-8133-44ab-9efd-865c64f496c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:21.464959 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4099a7b6-8133-44ab-9efd-865c64f496c2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1721 microversion: 2.20 time: 0.177736 Jun 16 17:29:21.465555 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 380/757] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:21 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:21.511635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-fe4e6c4f-54d3-4dff-bbab-aa5917c204c5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:21.514066 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:21.526686 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-fe4e6c4f-54d3-4dff-bbab-aa5917c204c5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1145 microversion: 2.1 time: 0.115229 Jun 16 17:29:21.527267 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 378/758] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:21 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1145 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:22.487900 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-209d6e98-8757-467b-ba53-215242c214c0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:22.488887 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-209d6e98-8757-467b-ba53-215242c214c0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:22.499371 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-209d6e98-8757-467b-ba53-215242c214c0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:22.500066 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-209d6e98-8757-467b-ba53-215242c214c0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:22.501345 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-209d6e98-8757-467b-ba53-215242c214c0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:22.502013 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-209d6e98-8757-467b-ba53-215242c214c0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:22.547077 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-abb669ea-25d1-4f1d-bd51-ad9fb07ee7f1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:22.548076 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-abb669ea-25d1-4f1d-bd51-ad9fb07ee7f1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:22.559094 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-abb669ea-25d1-4f1d-bd51-ad9fb07ee7f1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:22.559804 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-abb669ea-25d1-4f1d-bd51-ad9fb07ee7f1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:22.561070 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-abb669ea-25d1-4f1d-bd51-ad9fb07ee7f1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:22.561786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-abb669ea-25d1-4f1d-bd51-ad9fb07ee7f1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:22.647946 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-abb669ea-25d1-4f1d-bd51-ad9fb07ee7f1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:22.656035 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-abb669ea-25d1-4f1d-bd51-ad9fb07ee7f1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1145 microversion: 2.1 time: 0.115413 Jun 16 17:29:22.656615 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 379/759] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:22 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1145 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:22.672423 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-209d6e98-8757-467b-ba53-215242c214c0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:22.681893 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-209d6e98-8757-467b-ba53-215242c214c0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:22.683474 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-209d6e98-8757-467b-ba53-215242c214c0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:22.684815 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-209d6e98-8757-467b-ba53-215242c214c0 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1721 microversion: 2.20 time: 0.203716 Jun 16 17:29:22.685521 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 381/760] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:22 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:22.924299 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-c950c58e-f2bf-404c-9b3c-97e1c00adfc1 req-a486c59d-5b93-42f5-b051-f4a366cc436c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4", "name": "network-vif-unplugged", "status": "completed", "tag": "8d7a682c-8735-4554-a952-dc548868e5d9"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:29:22.934572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-c950c58e-f2bf-404c-9b3c-97e1c00adfc1 req-a486c59d-5b93-42f5-b051-f4a366cc436c service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:22.936015 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-c950c58e-f2bf-404c-9b3c-97e1c00adfc1 req-a486c59d-5b93-42f5-b051-f4a366cc436c service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:22.951285 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-c950c58e-f2bf-404c-9b3c-97e1c00adfc1 req-a486c59d-5b93-42f5-b051-f4a366cc436c service nova] Creating event network-vif-unplugged:8d7a682c-8735-4554-a952-dc548868e5d9 for instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 on hv-cinder-83735 Jun 16 17:29:22.956875 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-c950c58e-f2bf-404c-9b3c-97e1c00adfc1 req-a486c59d-5b93-42f5-b051-f4a366cc436c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036674 Jun 16 17:29:22.957754 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 380/761] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:29:23.676023 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-cedc5519-8b63-41cb-861c-f2c2ad43c6ab tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:23.676661 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-cedc5519-8b63-41cb-861c-f2c2ad43c6ab tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:23.685027 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cedc5519-8b63-41cb-861c-f2c2ad43c6ab tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:23.685502 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cedc5519-8b63-41cb-861c-f2c2ad43c6ab tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:23.686276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cedc5519-8b63-41cb-861c-f2c2ad43c6ab tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:23.686709 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cedc5519-8b63-41cb-861c-f2c2ad43c6ab tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:23.690162 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:23.704462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-3db24a20-276d-42fc-8037-b3417789169e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:23.705379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-3db24a20-276d-42fc-8037-b3417789169e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:23.712131 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3db24a20-276d-42fc-8037-b3417789169e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:23.712575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3db24a20-276d-42fc-8037-b3417789169e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:23.713398 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3db24a20-276d-42fc-8037-b3417789169e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:23.713830 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3db24a20-276d-42fc-8037-b3417789169e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:23.772161 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-cedc5519-8b63-41cb-861c-f2c2ad43c6ab tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:23.787893 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-cedc5519-8b63-41cb-861c-f2c2ad43c6ab tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1137 microversion: 2.1 time: 0.117488 Jun 16 17:29:23.788613 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 382/762] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:23 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1137 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:23.894406 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-3db24a20-276d-42fc-8037-b3417789169e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:23.908260 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-3db24a20-276d-42fc-8037-b3417789169e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:23.909937 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-3db24a20-276d-42fc-8037-b3417789169e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:23.911079 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-3db24a20-276d-42fc-8037-b3417789169e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1724 microversion: 2.20 time: 0.211383 Jun 16 17:29:23.912856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 381/763] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:23 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:23.937903 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c3662908-1274-4f47-836c-424ef8bf9bff tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88a5c435-defd-40b9-874b-a45052f63c40"}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:29:23.946514 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c3662908-1274-4f47-836c-424ef8bf9bff tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:23.946514 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c3662908-1274-4f47-836c-424ef8bf9bff tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:23.946514 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c3662908-1274-4f47-836c-424ef8bf9bff tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:23.951390 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c3662908-1274-4f47-836c-424ef8bf9bff tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:23.951390 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c3662908-1274-4f47-836c-424ef8bf9bff tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:24.211001 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ffea43ad-39de-4424-97fe-dc98a559b080 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:24.212121 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ffea43ad-39de-4424-97fe-dc98a559b080 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:24.218690 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ffea43ad-39de-4424-97fe-dc98a559b080 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:24.219280 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ffea43ad-39de-4424-97fe-dc98a559b080 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:24.220161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ffea43ad-39de-4424-97fe-dc98a559b080 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:24.220699 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ffea43ad-39de-4424-97fe-dc98a559b080 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:24.258965 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ffea43ad-39de-4424-97fe-dc98a559b080 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052966 Jun 16 17:29:24.259556 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 382/764] 10.222.0.66 () {58 vars in 1301 bytes} [Thu Jun 16 17:29:24 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:29:24.330473 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c3662908-1274-4f47-836c-424ef8bf9bff tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "POST /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.396589 Jun 16 17:29:24.336457 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 383/765] 10.222.0.66 () {62 vars in 1363 bytes} [Thu Jun 16 17:29:23 2022] POST /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4/os-volume_attachments => generated 188 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:29:24.413946 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-27c683f7-8f4c-40eb-b030-60792e3e5c48 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:24.414813 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-27c683f7-8f4c-40eb-b030-60792e3e5c48 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:24.440162 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-27c683f7-8f4c-40eb-b030-60792e3e5c48 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:24.441051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-27c683f7-8f4c-40eb-b030-60792e3e5c48 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:24.442009 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-27c683f7-8f4c-40eb-b030-60792e3e5c48 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:24.452365 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-27c683f7-8f4c-40eb-b030-60792e3e5c48 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:24.502963 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-cb77a863-7db3-444d-9c31-19174ac8159e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:24.504038 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-cb77a863-7db3-444d-9c31-19174ac8159e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:24.515375 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cb77a863-7db3-444d-9c31-19174ac8159e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:24.515812 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cb77a863-7db3-444d-9c31-19174ac8159e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:24.516589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cb77a863-7db3-444d-9c31-19174ac8159e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:24.517779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-cb77a863-7db3-444d-9c31-19174ac8159e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:24.533417 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-27c683f7-8f4c-40eb-b030-60792e3e5c48 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments/2ce28b8a-4df1-4b27-8a2c-978f116c6151" status: 200 len: 194 microversion: 2.1 time: 0.125344 Jun 16 17:29:24.534313 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 383/766] 10.222.0.66 () {58 vars in 1412 bytes} [Thu Jun 16 17:29:24 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments/2ce28b8a-4df1-4b27-8a2c-978f116c6151 => generated 194 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:29:24.545238 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-94ca6a44-e2ca-4574-8296-91b3c966bb1d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:24.546289 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-94ca6a44-e2ca-4574-8296-91b3c966bb1d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:24.554320 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-94ca6a44-e2ca-4574-8296-91b3c966bb1d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:24.554902 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-94ca6a44-e2ca-4574-8296-91b3c966bb1d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:24.555801 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-94ca6a44-e2ca-4574-8296-91b3c966bb1d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:24.556506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-94ca6a44-e2ca-4574-8296-91b3c966bb1d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:24.704519 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.objects.instance [None req-94ca6a44-e2ca-4574-8296-91b3c966bb1d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lazy-loading 'services' on Instance uuid aeb07519-2ce6-44ee-a88c-d46b4e11b367 {{(pid=117552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:29:24.860692 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-cb77a863-7db3-444d-9c31-19174ac8159e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4/os-volume_attachments/88a5c435-defd-40b9-874b-a45052f63c40" status: 202 len: 0 microversion: 2.20 time: 0.362337 Jun 16 17:29:24.861801 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 384/767] 10.222.0.66 () {60 vars in 1456 bytes} [Thu Jun 16 17:29:24 2022] DELETE /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4/os-volume_attachments/88a5c435-defd-40b9-874b-a45052f63c40 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 17:29:24.869005 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d101326f-5d67-4bbf-80db-2120e34c1d81 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:24.869619 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-d101326f-5d67-4bbf-80db-2120e34c1d81 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:24.878749 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d101326f-5d67-4bbf-80db-2120e34c1d81 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:24.879452 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d101326f-5d67-4bbf-80db-2120e34c1d81 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:24.880672 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d101326f-5d67-4bbf-80db-2120e34c1d81 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:24.882754 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d101326f-5d67-4bbf-80db-2120e34c1d81 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:24.923203 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-94ca6a44-e2ca-4574-8296-91b3c966bb1d tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "DELETE /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments/2ce28b8a-4df1-4b27-8a2c-978f116c6151" status: 202 len: 0 microversion: 2.1 time: 0.381029 Jun 16 17:29:24.926620 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 384/768] 10.222.0.66 () {58 vars in 1415 bytes} [Thu Jun 16 17:29:24 2022] DELETE /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments/2ce28b8a-4df1-4b27-8a2c-978f116c6151 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:29:25.016914 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-4cc3f028-61d2-4b30-b3c3-93e0f7aeae98 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:29:25.018228 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-4cc3f028-61d2-4b30-b3c3-93e0f7aeae98 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:25.034774 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4cc3f028-61d2-4b30-b3c3-93e0f7aeae98 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:25.036038 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4cc3f028-61d2-4b30-b3c3-93e0f7aeae98 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:25.039080 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4cc3f028-61d2-4b30-b3c3-93e0f7aeae98 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:25.040229 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4cc3f028-61d2-4b30-b3c3-93e0f7aeae98 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:25.045432 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d101326f-5d67-4bbf-80db-2120e34c1d81 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:25.057830 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-d101326f-5d67-4bbf-80db-2120e34c1d81 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1211 microversion: 2.1 time: 0.194805 Jun 16 17:29:25.058690 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 385/769] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:24 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1211 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:25.212841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-4cc3f028-61d2-4b30-b3c3-93e0f7aeae98 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "POST /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4/action" status: 202 len: 0 microversion: 2.20 time: 0.207812 Jun 16 17:29:25.219142 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 385/770] 10.222.0.66 () {62 vars in 1318 bytes} [Thu Jun 16 17:29:25 2022] POST /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:29:25.224511 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4495881f-e5f2-47d3-8006-36ab8cc71b21 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:25.225118 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4495881f-e5f2-47d3-8006-36ab8cc71b21 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:25.232597 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4495881f-e5f2-47d3-8006-36ab8cc71b21 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:25.233195 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4495881f-e5f2-47d3-8006-36ab8cc71b21 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:25.234183 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4495881f-e5f2-47d3-8006-36ab8cc71b21 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:25.234615 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4495881f-e5f2-47d3-8006-36ab8cc71b21 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:25.527319 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4495881f-e5f2-47d3-8006-36ab8cc71b21 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:25.549137 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4495881f-e5f2-47d3-8006-36ab8cc71b21 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:25.551049 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4495881f-e5f2-47d3-8006-36ab8cc71b21 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:25.553415 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4495881f-e5f2-47d3-8006-36ab8cc71b21 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1672 microversion: 2.20 time: 0.333293 Jun 16 17:29:25.555113 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 386/771] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:25 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1672 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:29:26.083142 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-4dd6154f-5e2a-4862-9898-3bf0b9a977d0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:26.084724 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-4dd6154f-5e2a-4862-9898-3bf0b9a977d0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:26.097071 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4dd6154f-5e2a-4862-9898-3bf0b9a977d0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:26.102054 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4dd6154f-5e2a-4862-9898-3bf0b9a977d0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:26.103168 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4dd6154f-5e2a-4862-9898-3bf0b9a977d0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:26.103706 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4dd6154f-5e2a-4862-9898-3bf0b9a977d0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:26.154372 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a84a30a2-2367-4c30-a7c4-d4a9d407ca01 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:26.156664 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a84a30a2-2367-4c30-a7c4-d4a9d407ca01 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:26.167879 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a84a30a2-2367-4c30-a7c4-d4a9d407ca01 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:26.168582 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a84a30a2-2367-4c30-a7c4-d4a9d407ca01 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:26.169587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a84a30a2-2367-4c30-a7c4-d4a9d407ca01 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:26.170176 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a84a30a2-2367-4c30-a7c4-d4a9d407ca01 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:26.246555 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a84a30a2-2367-4c30-a7c4-d4a9d407ca01 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments/b32716a1-c164-41cb-9fe4-dab222440732" status: 200 len: 194 microversion: 2.1 time: 0.101149 Jun 16 17:29:26.250188 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 387/772] 10.222.0.66 () {58 vars in 1412 bytes} [Thu Jun 16 17:29:26 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments/b32716a1-c164-41cb-9fe4-dab222440732 => generated 194 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:29:26.265523 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-e423599f-0642-49ca-a225-4cb8907818a7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:26.266254 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-e423599f-0642-49ca-a225-4cb8907818a7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:26.273805 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e423599f-0642-49ca-a225-4cb8907818a7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:26.274332 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e423599f-0642-49ca-a225-4cb8907818a7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:26.275111 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e423599f-0642-49ca-a225-4cb8907818a7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:26.275534 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e423599f-0642-49ca-a225-4cb8907818a7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:26.391375 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.objects.instance [None req-e423599f-0642-49ca-a225-4cb8907818a7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lazy-loading 'services' on Instance uuid aeb07519-2ce6-44ee-a88c-d46b4e11b367 {{(pid=117553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:29:26.481623 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-4dd6154f-5e2a-4862-9898-3bf0b9a977d0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:26.493315 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-4dd6154f-5e2a-4862-9898-3bf0b9a977d0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1266 microversion: 2.1 time: 0.414631 Jun 16 17:29:26.494312 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 386/773] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:26 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1266 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:26.495949 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-e423599f-0642-49ca-a225-4cb8907818a7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "DELETE /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments/b32716a1-c164-41cb-9fe4-dab222440732" status: 202 len: 0 microversion: 2.1 time: 0.240475 Jun 16 17:29:26.513449 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 388/774] 10.222.0.66 () {58 vars in 1415 bytes} [Thu Jun 16 17:29:26 2022] DELETE /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments/b32716a1-c164-41cb-9fe4-dab222440732 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:29:26.578505 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0d9bdf54-3180-41dd-b261-f097762a1792 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:26.580404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0d9bdf54-3180-41dd-b261-f097762a1792 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:26.591676 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d9bdf54-3180-41dd-b261-f097762a1792 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:26.592518 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d9bdf54-3180-41dd-b261-f097762a1792 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:26.593797 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d9bdf54-3180-41dd-b261-f097762a1792 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:26.594526 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d9bdf54-3180-41dd-b261-f097762a1792 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:26.903469 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0d9bdf54-3180-41dd-b261-f097762a1792 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:26.917550 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0d9bdf54-3180-41dd-b261-f097762a1792 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:26.920439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0d9bdf54-3180-41dd-b261-f097762a1792 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:26.922034 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0d9bdf54-3180-41dd-b261-f097762a1792 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1672 microversion: 2.20 time: 0.349981 Jun 16 17:29:26.923699 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 387/775] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:26 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1672 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:26.999048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-5f2acdcb-fb34-41c3-998f-f511c28ff99b req-a11d20b4-1422-483b-838f-4e2a2405fe77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5b6345-48fe-44a0-b917-2b12902e234b", "tag": "ccefb110-1f8f-47f6-a66f-5a8c5114a8dc"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:29:27.069434 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-5f2acdcb-fb34-41c3-998f-f511c28ff99b req-a11d20b4-1422-483b-838f-4e2a2405fe77 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:27.070339 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-5f2acdcb-fb34-41c3-998f-f511c28ff99b req-a11d20b4-1422-483b-838f-4e2a2405fe77 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:27.106222 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-5f2acdcb-fb34-41c3-998f-f511c28ff99b req-a11d20b4-1422-483b-838f-4e2a2405fe77 service nova] Creating event network-changed:ccefb110-1f8f-47f6-a66f-5a8c5114a8dc for instance ce5b6345-48fe-44a0-b917-2b12902e234b on hv-cinder-83735 Jun 16 17:29:27.125371 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-5f2acdcb-fb34-41c3-998f-f511c28ff99b req-a11d20b4-1422-483b-838f-4e2a2405fe77 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132378 Jun 16 17:29:27.126512 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 389/776] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:29:27.519006 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d1edc185-9ffa-45c6-ae50-ecbfc6ef1ace tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:27.520011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d1edc185-9ffa-45c6-ae50-ecbfc6ef1ace tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:27.529169 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d1edc185-9ffa-45c6-ae50-ecbfc6ef1ace tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:27.529843 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d1edc185-9ffa-45c6-ae50-ecbfc6ef1ace tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:27.530862 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d1edc185-9ffa-45c6-ae50-ecbfc6ef1ace tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:27.531931 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d1edc185-9ffa-45c6-ae50-ecbfc6ef1ace tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:27.709202 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d1edc185-9ffa-45c6-ae50-ecbfc6ef1ace tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:27.718452 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d1edc185-9ffa-45c6-ae50-ecbfc6ef1ace tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1266 microversion: 2.1 time: 0.203978 Jun 16 17:29:27.719063 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 388/777] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:27 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:29:27.846291 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-bdfe6096-a58e-43cd-b10d-ea3681700c41 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:27.848054 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-bdfe6096-a58e-43cd-b10d-ea3681700c41 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:27.855525 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bdfe6096-a58e-43cd-b10d-ea3681700c41 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:27.856089 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bdfe6096-a58e-43cd-b10d-ea3681700c41 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:27.857213 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bdfe6096-a58e-43cd-b10d-ea3681700c41 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:27.862421 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-bdfe6096-a58e-43cd-b10d-ea3681700c41 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:27.909704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-bdfe6096-a58e-43cd-b10d-ea3681700c41 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068021 Jun 16 17:29:27.910301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 390/778] 10.222.0.66 () {58 vars in 1301 bytes} [Thu Jun 16 17:29:27 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:29:27.945243 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-77263c58-9134-47cd-955d-8ddfba926136 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:27.945783 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-77263c58-9134-47cd-955d-8ddfba926136 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:27.953858 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-77263c58-9134-47cd-955d-8ddfba926136 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:27.954534 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-77263c58-9134-47cd-955d-8ddfba926136 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:27.955447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-77263c58-9134-47cd-955d-8ddfba926136 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:27.955882 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-77263c58-9134-47cd-955d-8ddfba926136 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:28.048654 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-9a19b3a0-604e-47f6-a603-21473eba2e17 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:28.049852 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-9a19b3a0-604e-47f6-a603-21473eba2e17 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:28.057431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9a19b3a0-604e-47f6-a603-21473eba2e17 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:28.057874 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9a19b3a0-604e-47f6-a603-21473eba2e17 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:28.058887 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9a19b3a0-604e-47f6-a603-21473eba2e17 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:28.059448 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9a19b3a0-604e-47f6-a603-21473eba2e17 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:28.110818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-9a19b3a0-604e-47f6-a603-21473eba2e17 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065847 Jun 16 17:29:28.124188 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 391/779] 10.222.0.66 () {58 vars in 1301 bytes} [Thu Jun 16 17:29:28 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 17:29:28.218841 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-933bde45-0590-4879-9c95-a16351abb949 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:28.220474 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-933bde45-0590-4879-9c95-a16351abb949 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:28.228547 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-933bde45-0590-4879-9c95-a16351abb949 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:28.229011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-933bde45-0590-4879-9c95-a16351abb949 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:28.230190 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-933bde45-0590-4879-9c95-a16351abb949 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:28.230623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-933bde45-0590-4879-9c95-a16351abb949 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:28.249293 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-77263c58-9134-47cd-955d-8ddfba926136 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:28.266312 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-77263c58-9134-47cd-955d-8ddfba926136 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:28.267291 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-933bde45-0590-4879-9c95-a16351abb949 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Going to try to terminate instance {{(pid=117553) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:29:28.270163 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-77263c58-9134-47cd-955d-8ddfba926136 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:28.272868 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-77263c58-9134-47cd-955d-8ddfba926136 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1730 microversion: 2.20 time: 0.333283 Jun 16 17:29:28.274668 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 389/780] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:27 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1730 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:28.309437 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=6,nova_cell1:UPDATE=8 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:28.398794 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-933bde45-0590-4879-9c95-a16351abb949 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "DELETE /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 204 len: 0 microversion: 2.1 time: 0.187171 Jun 16 17:29:28.399869 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 392/781] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:29:28 2022] DELETE /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:29:28.407910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b8e54e59-4e16-402c-8180-c7be4a77f1c7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:28.408635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b8e54e59-4e16-402c-8180-c7be4a77f1c7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:28.415260 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b8e54e59-4e16-402c-8180-c7be4a77f1c7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:28.415713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b8e54e59-4e16-402c-8180-c7be4a77f1c7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:28.416503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b8e54e59-4e16-402c-8180-c7be4a77f1c7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:28.417108 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b8e54e59-4e16-402c-8180-c7be4a77f1c7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:28.611829 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-b8e54e59-4e16-402c-8180-c7be4a77f1c7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:28.622982 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b8e54e59-4e16-402c-8180-c7be4a77f1c7 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1675 microversion: 2.1 time: 0.218984 Jun 16 17:29:28.623571 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 390/782] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:28 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1675 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:28.740332 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-64ad27a6-8ecb-442b-abdc-73016378c01d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:28.741043 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-64ad27a6-8ecb-442b-abdc-73016378c01d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:28.748550 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-64ad27a6-8ecb-442b-abdc-73016378c01d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:28.749005 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-64ad27a6-8ecb-442b-abdc-73016378c01d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:28.749693 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-64ad27a6-8ecb-442b-abdc-73016378c01d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:28.750078 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-64ad27a6-8ecb-442b-abdc-73016378c01d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:28.988918 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-64ad27a6-8ecb-442b-abdc-73016378c01d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:29.005693 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-64ad27a6-8ecb-442b-abdc-73016378c01d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1266 microversion: 2.1 time: 0.270017 Jun 16 17:29:29.008312 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 393/783] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:28 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:29:29.293354 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0136b314-8e3b-4bf5-afb1-cadac8b31b1d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:29.294061 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0136b314-8e3b-4bf5-afb1-cadac8b31b1d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:29.308366 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0136b314-8e3b-4bf5-afb1-cadac8b31b1d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:29.309660 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0136b314-8e3b-4bf5-afb1-cadac8b31b1d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:29.311460 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0136b314-8e3b-4bf5-afb1-cadac8b31b1d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:29.312624 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0136b314-8e3b-4bf5-afb1-cadac8b31b1d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:29.647245 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ae8dadfb-38af-465f-b960-a69110c91259 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:29.648785 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ae8dadfb-38af-465f-b960-a69110c91259 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:29.659623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ae8dadfb-38af-465f-b960-a69110c91259 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:29.660788 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ae8dadfb-38af-465f-b960-a69110c91259 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:29.663489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ae8dadfb-38af-465f-b960-a69110c91259 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:29.664550 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ae8dadfb-38af-465f-b960-a69110c91259 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:29.701953 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0136b314-8e3b-4bf5-afb1-cadac8b31b1d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:29.712086 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0136b314-8e3b-4bf5-afb1-cadac8b31b1d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:29.714022 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0136b314-8e3b-4bf5-afb1-cadac8b31b1d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:29.715528 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0136b314-8e3b-4bf5-afb1-cadac8b31b1d tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1730 microversion: 2.20 time: 0.426493 Jun 16 17:29:29.716795 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 391/784] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:29 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1730 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:29.929674 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ae8dadfb-38af-465f-b960-a69110c91259 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:29.939940 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ae8dadfb-38af-465f-b960-a69110c91259 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1675 microversion: 2.1 time: 0.300377 Jun 16 17:29:29.940547 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 394/785] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:29 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1675 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:30.025159 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b133444f-7c28-4c30-90a6-de8261d07802 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:30.026237 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b133444f-7c28-4c30-90a6-de8261d07802 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:30.032801 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b133444f-7c28-4c30-90a6-de8261d07802 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:30.033683 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b133444f-7c28-4c30-90a6-de8261d07802 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:30.034999 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b133444f-7c28-4c30-90a6-de8261d07802 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:30.035657 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b133444f-7c28-4c30-90a6-de8261d07802 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:30.394605 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:30.472145 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-b133444f-7c28-4c30-90a6-de8261d07802 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:30.483754 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b133444f-7c28-4c30-90a6-de8261d07802 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1266 microversion: 2.1 time: 0.464143 Jun 16 17:29:30.494624 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 392/786] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:30 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1266 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:30.734831 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b800bc2e-b7bb-49fd-976e-211fd0197b99 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:30.736526 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-b800bc2e-b7bb-49fd-976e-211fd0197b99 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:30.747664 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:30.748799 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=6 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:30.753405 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b800bc2e-b7bb-49fd-976e-211fd0197b99 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:30.754173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b800bc2e-b7bb-49fd-976e-211fd0197b99 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:30.755268 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b800bc2e-b7bb-49fd-976e-211fd0197b99 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:30.755812 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-b800bc2e-b7bb-49fd-976e-211fd0197b99 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:30.928868 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b800bc2e-b7bb-49fd-976e-211fd0197b99 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:30.938373 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b800bc2e-b7bb-49fd-976e-211fd0197b99 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:30.940645 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-b800bc2e-b7bb-49fd-976e-211fd0197b99 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:30.941867 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b800bc2e-b7bb-49fd-976e-211fd0197b99 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1730 microversion: 2.20 time: 0.211194 Jun 16 17:29:30.942546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 395/787] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:30 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:29:30.960711 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7edfc83c-6f11-4de4-a917-7a5c38eaa40c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:30.961381 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7edfc83c-6f11-4de4-a917-7a5c38eaa40c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:30.968486 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7edfc83c-6f11-4de4-a917-7a5c38eaa40c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:30.968966 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7edfc83c-6f11-4de4-a917-7a5c38eaa40c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:30.969791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7edfc83c-6f11-4de4-a917-7a5c38eaa40c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:30.970236 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7edfc83c-6f11-4de4-a917-7a5c38eaa40c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:31.419428 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7edfc83c-6f11-4de4-a917-7a5c38eaa40c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:31.428955 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7edfc83c-6f11-4de4-a917-7a5c38eaa40c tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1675 microversion: 2.1 time: 0.472531 Jun 16 17:29:31.439177 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 393/788] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:30 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1675 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:31.504279 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-6fa55e61-a9d4-42d1-a65a-a7a0a6efc634 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:31.504923 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-6fa55e61-a9d4-42d1-a65a-a7a0a6efc634 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:31.519491 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6fa55e61-a9d4-42d1-a65a-a7a0a6efc634 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:31.520269 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6fa55e61-a9d4-42d1-a65a-a7a0a6efc634 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:31.521549 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6fa55e61-a9d4-42d1-a65a-a7a0a6efc634 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:31.521997 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6fa55e61-a9d4-42d1-a65a-a7a0a6efc634 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:31.721220 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6fa55e61-a9d4-42d1-a65a-a7a0a6efc634 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:31.729928 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-6fa55e61-a9d4-42d1-a65a-a7a0a6efc634 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1266 microversion: 2.1 time: 0.230970 Jun 16 17:29:31.731256 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 396/789] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:31 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:31.960253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d3304de7-40f7-4f39-8538-01f27595b92e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:31.960885 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d3304de7-40f7-4f39-8538-01f27595b92e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:31.971317 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d3304de7-40f7-4f39-8538-01f27595b92e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:31.971972 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d3304de7-40f7-4f39-8538-01f27595b92e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:31.972606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d3304de7-40f7-4f39-8538-01f27595b92e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:31.976433 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d3304de7-40f7-4f39-8538-01f27595b92e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:32.017387 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:32.446840 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c21ed6a9-0bbc-47f6-a424-8c1bf4c08fda tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:32.448156 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c21ed6a9-0bbc-47f6-a424-8c1bf4c08fda tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:32.467151 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c21ed6a9-0bbc-47f6-a424-8c1bf4c08fda tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:32.476267 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c21ed6a9-0bbc-47f6-a424-8c1bf4c08fda tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:32.477501 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c21ed6a9-0bbc-47f6-a424-8c1bf4c08fda tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:32.479877 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c21ed6a9-0bbc-47f6-a424-8c1bf4c08fda tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:32.633993 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d3304de7-40f7-4f39-8538-01f27595b92e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:32.661766 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d3304de7-40f7-4f39-8538-01f27595b92e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:32.669559 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d3304de7-40f7-4f39-8538-01f27595b92e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:32.676307 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d3304de7-40f7-4f39-8538-01f27595b92e tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1730 microversion: 2.20 time: 0.719829 Jun 16 17:29:32.678627 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 394/790] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:31 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1730 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:32.750140 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c21ed6a9-0bbc-47f6-a424-8c1bf4c08fda tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:32.760403 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-dc94141f-3aca-4e07-a642-6d33e13495fa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:32.766113 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-dc94141f-3aca-4e07-a642-6d33e13495fa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:32.767776 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c21ed6a9-0bbc-47f6-a424-8c1bf4c08fda tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1675 microversion: 2.1 time: 0.324792 Jun 16 17:29:32.769252 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 397/791] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:32 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1675 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:29:32.795764 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-dc94141f-3aca-4e07-a642-6d33e13495fa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:32.797044 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-dc94141f-3aca-4e07-a642-6d33e13495fa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:32.798781 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-dc94141f-3aca-4e07-a642-6d33e13495fa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:32.799813 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-dc94141f-3aca-4e07-a642-6d33e13495fa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:33.200140 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-dc94141f-3aca-4e07-a642-6d33e13495fa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:33.212764 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-dc94141f-3aca-4e07-a642-6d33e13495fa tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1266 microversion: 2.1 time: 0.461061 Jun 16 17:29:33.214423 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 395/792] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:32 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1266 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:33.566463 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-d98756a9-6c99-4abc-8414-40c3c2c69beb req-90e1b38f-74f2-465f-bede-7fdafa9d947f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeb07519-2ce6-44ee-a88c-d46b4e11b367", "name": "network-vif-deleted", "tag": "7176d454-867c-4dc6-b412-5623b5292926"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:29:33.616599 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-d98756a9-6c99-4abc-8414-40c3c2c69beb req-90e1b38f-74f2-465f-bede-7fdafa9d947f service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:33.617045 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-d98756a9-6c99-4abc-8414-40c3c2c69beb req-90e1b38f-74f2-465f-bede-7fdafa9d947f service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:33.636997 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-d98756a9-6c99-4abc-8414-40c3c2c69beb req-90e1b38f-74f2-465f-bede-7fdafa9d947f service nova] Creating event network-vif-deleted:7176d454-867c-4dc6-b412-5623b5292926 for instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 on hv-cinder-83735 Jun 16 17:29:33.643263 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-d98756a9-6c99-4abc-8414-40c3c2c69beb req-90e1b38f-74f2-465f-bede-7fdafa9d947f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081828 Jun 16 17:29:33.644441 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 398/793] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:29:33.699034 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-2c8c8558-39d6-4264-a787-bc0eeab084e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:33.700026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-2c8c8558-39d6-4264-a787-bc0eeab084e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:33.709724 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2c8c8558-39d6-4264-a787-bc0eeab084e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:33.713821 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2c8c8558-39d6-4264-a787-bc0eeab084e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:33.715761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2c8c8558-39d6-4264-a787-bc0eeab084e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:33.720733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2c8c8558-39d6-4264-a787-bc0eeab084e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:33.800155 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-3e3a2cc0-19d4-470a-9cd1-652c4cccd764 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:33.804669 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-3e3a2cc0-19d4-470a-9cd1-652c4cccd764 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:33.839390 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3e3a2cc0-19d4-470a-9cd1-652c4cccd764 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:33.841126 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3e3a2cc0-19d4-470a-9cd1-652c4cccd764 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:33.842328 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3e3a2cc0-19d4-470a-9cd1-652c4cccd764 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:33.843048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3e3a2cc0-19d4-470a-9cd1-652c4cccd764 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:34.049466 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-3e3a2cc0-19d4-470a-9cd1-652c4cccd764 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:34.059626 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-3e3a2cc0-19d4-470a-9cd1-652c4cccd764 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1607 microversion: 2.1 time: 0.266615 Jun 16 17:29:34.068983 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 399/794] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:33 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1607 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:34.137670 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2c8c8558-39d6-4264-a787-bc0eeab084e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:34.151921 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2c8c8558-39d6-4264-a787-bc0eeab084e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:34.157005 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2c8c8558-39d6-4264-a787-bc0eeab084e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:34.160698 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-2c8c8558-39d6-4264-a787-bc0eeab084e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1730 microversion: 2.20 time: 0.467549 Jun 16 17:29:34.161794 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 396/795] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:33 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1730 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:34.233226 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c6c598b5-fbb8-4ed2-ad35-b092443ac20d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:34.234764 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c6c598b5-fbb8-4ed2-ad35-b092443ac20d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:34.242610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c6c598b5-fbb8-4ed2-ad35-b092443ac20d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:34.243052 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c6c598b5-fbb8-4ed2-ad35-b092443ac20d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:34.243823 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c6c598b5-fbb8-4ed2-ad35-b092443ac20d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:34.244278 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c6c598b5-fbb8-4ed2-ad35-b092443ac20d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:34.462420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c6c598b5-fbb8-4ed2-ad35-b092443ac20d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:34.493289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c6c598b5-fbb8-4ed2-ad35-b092443ac20d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1266 microversion: 2.1 time: 0.264645 Jun 16 17:29:34.498222 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 400/796] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:34 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:35.086704 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-fe58bd54-09cc-405f-92bb-5e552c2416df tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:35.087518 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-fe58bd54-09cc-405f-92bb-5e552c2416df tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:35.091194 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:35.115478 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fe58bd54-09cc-405f-92bb-5e552c2416df tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:35.122312 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fe58bd54-09cc-405f-92bb-5e552c2416df tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:35.124828 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fe58bd54-09cc-405f-92bb-5e552c2416df tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:35.129416 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-fe58bd54-09cc-405f-92bb-5e552c2416df tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:35.179444 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-34bfd8b3-9ea4-419f-94ce-7972a701665c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:35.181736 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-34bfd8b3-9ea4-419f-94ce-7972a701665c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:35.185595 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:35.246892 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-34bfd8b3-9ea4-419f-94ce-7972a701665c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:35.247519 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-34bfd8b3-9ea4-419f-94ce-7972a701665c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:35.248407 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-34bfd8b3-9ea4-419f-94ce-7972a701665c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:35.248844 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-34bfd8b3-9ea4-419f-94ce-7972a701665c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:35.274100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-fe58bd54-09cc-405f-92bb-5e552c2416df tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3418bd5d7f430ca84efd5c83e38fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f029a8bb389c4d348c0e9001c5fa059c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:35.294730 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-fe58bd54-09cc-405f-92bb-5e552c2416df tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 200 len: 1323 microversion: 2.1 time: 0.207967 Jun 16 17:29:35.310711 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 397/797] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:35 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 1323 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:35.514829 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-1f16249b-6282-40f5-8430-d0dec907f377 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:35.515763 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-1f16249b-6282-40f5-8430-d0dec907f377 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:35.527328 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1f16249b-6282-40f5-8430-d0dec907f377 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:35.528162 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1f16249b-6282-40f5-8430-d0dec907f377 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:35.532089 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1f16249b-6282-40f5-8430-d0dec907f377 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:35.533319 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1f16249b-6282-40f5-8430-d0dec907f377 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:35.835053 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-1f16249b-6282-40f5-8430-d0dec907f377 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:35.859120 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-1f16249b-6282-40f5-8430-d0dec907f377 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1266 microversion: 2.1 time: 0.347726 Jun 16 17:29:35.864925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 398/798] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:35 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:29:36.318364 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-56078099-6ed4-4b58-be80-3021e6821618 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:36.322542 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-56078099-6ed4-4b58-be80-3021e6821618 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:36.339044 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-56078099-6ed4-4b58-be80-3021e6821618 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:36.339682 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-56078099-6ed4-4b58-be80-3021e6821618 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:36.340983 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-56078099-6ed4-4b58-be80-3021e6821618 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:36.341606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-56078099-6ed4-4b58-be80-3021e6821618 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:36.389840 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-56078099-6ed4-4b58-be80-3021e6821618 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] HTTP exception thrown: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-56078099-6ed4-4b58-be80-3021e6821618 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Request method failure captured: Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 HTTP/1.1 Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2beuWk7EZlEjA9yRMTDbNejBZxpiStz8muB1t5YfyUNjOp366FElg-CGG7YxZd-LPYYcDXJpDnt37xIZKURu01Wg9u2dzkYnziyBT6e1zA88cgUmblIzeM6q8-Ibj73wyofaPbdJ0KQJkVcnySSy9zuDYNkRjPIMYbkXjjXewjdmZU Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: f029a8bb389c4d348c0e9001c5fa059c Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:29:36.397818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:29:36.399950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f029a8bb389c4d348c0e9001c5fa059c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f029a8bb389c4d348c0e9001c5fa059c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f029a8bb389c4d348c0e9001c5fa059c", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f029a8bb389c4d348c0e9001c5fa059c"}]}] Jun 16 17:29:36.399950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:29:36.399950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: f029a8bb389c4d348c0e9001c5fa059c Jun 16 17:29:36.399950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:29:36.399950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-AttachVolumeTestJSON-336390128-project Jun 16 17:29:36.399950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:29:36.399950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:29:36.399950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 1a3418bd5d7f430ca84efd5c83e38fed Jun 16 17:29:36.399950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-AttachVolumeTestJSON-336390128-project Jun 16 17:29:36.399950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:29:36.399950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. Jun 16 17:29:36.399950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': 'aeb07519-2ce6-44ee-a88c-d46b4e11b367'} Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:29:36.401139 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. Jun 16 17:29:36.402841 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:29:36.405712 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-56078099-6ed4-4b58-be80-3021e6821618 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Returning 404 to user: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:29:36.406783 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-56078099-6ed4-4b58-be80-3021e6821618 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 404 len: 111 microversion: 2.1 time: 0.096388 Jun 16 17:29:36.413504 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 399/799] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:36 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:29:36.428214 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-07c9ecf4-671b-41fe-83ac-e10c550e4f88 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '.version_select at 0x7f66b15ae160>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:36.501629 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-07c9ecf4-671b-41fe-83ac-e10c550e4f88 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705009479" status: 202 len: 0 microversion: 2.1 time: 0.085221 Jun 16 17:29:36.507669 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 400/800] 10.222.0.66 () {58 vars in 1220 bytes} [Thu Jun 16 17:29:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705009479 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:29:36.726959 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-34bfd8b3-9ea4-419f-94ce-7972a701665c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:36.742303 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-34bfd8b3-9ea4-419f-94ce-7972a701665c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:36.747122 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-34bfd8b3-9ea4-419f-94ce-7972a701665c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:36.749077 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-34bfd8b3-9ea4-419f-94ce-7972a701665c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1730 microversion: 2.20 time: 1.573938 Jun 16 17:29:36.773283 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 401/801] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:35 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1730 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:36.887055 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-031400ee-2786-489a-b353-23d7512ddbc7 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:36.898390 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-031400ee-2786-489a-b353-23d7512ddbc7 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:36.925007 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-031400ee-2786-489a-b353-23d7512ddbc7 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:36.925605 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-031400ee-2786-489a-b353-23d7512ddbc7 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:36.928161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-031400ee-2786-489a-b353-23d7512ddbc7 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:36.931381 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-031400ee-2786-489a-b353-23d7512ddbc7 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:37.482461 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-031400ee-2786-489a-b353-23d7512ddbc7 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:37.507315 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-031400ee-2786-489a-b353-23d7512ddbc7 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1266 microversion: 2.1 time: 0.627916 Jun 16 17:29:37.507814 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 401/802] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:36 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1266 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:29:37.784077 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-77760ce3-3218-4d7c-87ee-15a206cb69e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:37.785254 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-77760ce3-3218-4d7c-87ee-15a206cb69e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:37.821194 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-77760ce3-3218-4d7c-87ee-15a206cb69e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:37.824778 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-77760ce3-3218-4d7c-87ee-15a206cb69e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:37.826129 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-77760ce3-3218-4d7c-87ee-15a206cb69e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:37.829286 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-77760ce3-3218-4d7c-87ee-15a206cb69e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:38.120601 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-77760ce3-3218-4d7c-87ee-15a206cb69e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:38.149257 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-77760ce3-3218-4d7c-87ee-15a206cb69e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:38.150753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-77760ce3-3218-4d7c-87ee-15a206cb69e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:38.151954 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-77760ce3-3218-4d7c-87ee-15a206cb69e9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1730 microversion: 2.20 time: 0.375239 Jun 16 17:29:38.163068 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 402/803] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:37 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1730 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:38.531155 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-762c6ef3-7da2-4401-8b3b-fa961bb3faf7 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:38.532487 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-762c6ef3-7da2-4401-8b3b-fa961bb3faf7 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:38.566891 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-762c6ef3-7da2-4401-8b3b-fa961bb3faf7 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:38.568203 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-762c6ef3-7da2-4401-8b3b-fa961bb3faf7 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:38.571648 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-762c6ef3-7da2-4401-8b3b-fa961bb3faf7 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:38.572501 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-762c6ef3-7da2-4401-8b3b-fa961bb3faf7 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:38.859160 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-762c6ef3-7da2-4401-8b3b-fa961bb3faf7 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:38.873267 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-762c6ef3-7da2-4401-8b3b-fa961bb3faf7 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1266 microversion: 2.1 time: 0.348476 Jun 16 17:29:38.875437 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 402/804] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:38 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1266 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:39.172572 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c213ec62-f1b8-4ac1-b109-833d6a17862c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:39.174053 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c213ec62-f1b8-4ac1-b109-833d6a17862c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:39.186743 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c213ec62-f1b8-4ac1-b109-833d6a17862c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:39.188988 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c213ec62-f1b8-4ac1-b109-833d6a17862c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:39.194033 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c213ec62-f1b8-4ac1-b109-833d6a17862c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:39.194742 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c213ec62-f1b8-4ac1-b109-833d6a17862c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:39.291963 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-cb230b8b-00dc-4fbc-826a-4398a07cc4e3 req-774e91c5-304f-4c01-9099-c8b7d8f10b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5b6345-48fe-44a0-b917-2b12902e234b", "name": "network-vif-plugged", "status": "completed", "tag": "ccefb110-1f8f-47f6-a66f-5a8c5114a8dc"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:29:39.329894 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-cb230b8b-00dc-4fbc-826a-4398a07cc4e3 req-774e91c5-304f-4c01-9099-c8b7d8f10b28 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:39.339661 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-cb230b8b-00dc-4fbc-826a-4398a07cc4e3 req-774e91c5-304f-4c01-9099-c8b7d8f10b28 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:39.375578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-cb230b8b-00dc-4fbc-826a-4398a07cc4e3 req-774e91c5-304f-4c01-9099-c8b7d8f10b28 service nova] Creating event network-vif-plugged:ccefb110-1f8f-47f6-a66f-5a8c5114a8dc for instance ce5b6345-48fe-44a0-b917-2b12902e234b on hv-cinder-83735 Jun 16 17:29:39.389126 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-cb230b8b-00dc-4fbc-826a-4398a07cc4e3 req-774e91c5-304f-4c01-9099-c8b7d8f10b28 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112490 Jun 16 17:29:39.390170 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 403/805] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:29:39.817454 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c213ec62-f1b8-4ac1-b109-833d6a17862c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:39.837880 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c213ec62-f1b8-4ac1-b109-833d6a17862c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:39.841009 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c213ec62-f1b8-4ac1-b109-833d6a17862c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:39.844878 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c213ec62-f1b8-4ac1-b109-833d6a17862c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1730 microversion: 2.20 time: 0.676805 Jun 16 17:29:39.849275 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 403/806] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:39 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1730 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:39.904076 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-16357c5c-5c61-4cac-b635-87928e4c05e1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:39.904961 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-16357c5c-5c61-4cac-b635-87928e4c05e1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:39.919209 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-16357c5c-5c61-4cac-b635-87928e4c05e1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:39.920354 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-16357c5c-5c61-4cac-b635-87928e4c05e1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:39.921932 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-16357c5c-5c61-4cac-b635-87928e4c05e1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:39.928174 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-16357c5c-5c61-4cac-b635-87928e4c05e1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:40.305621 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-16357c5c-5c61-4cac-b635-87928e4c05e1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:40.318104 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-16357c5c-5c61-4cac-b635-87928e4c05e1 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1266 microversion: 2.1 time: 0.428469 Jun 16 17:29:40.321066 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 404/807] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:39 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1266 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:40.766950 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-65857571-2001-4aa9-b751-82d310f4dbd5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:40.769356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-65857571-2001-4aa9-b751-82d310f4dbd5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:40.798532 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-65857571-2001-4aa9-b751-82d310f4dbd5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:40.799331 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-65857571-2001-4aa9-b751-82d310f4dbd5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:40.801480 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-65857571-2001-4aa9-b751-82d310f4dbd5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:40.802153 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-65857571-2001-4aa9-b751-82d310f4dbd5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:40.834213 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-65857571-2001-4aa9-b751-82d310f4dbd5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] HTTP exception thrown: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-65857571-2001-4aa9-b751-82d310f4dbd5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Request method failure captured: Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: DELETE /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 HTTP/1.1 Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2beuWk7EZlEjA9yRMTDbNejBZxpiStz8muB1t5YfyUNjOp366FElg-CGG7YxZd-LPYYcDXJpDnt37xIZKURu01Wg9u2dzkYnziyBT6e1zA88cgUmblIzeM6q8-Ibj73wyofaPbdJ0KQJkVcnySSy9zuDYNkRjPIMYbkXjjXewjdmZU Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: f029a8bb389c4d348c0e9001c5fa059c Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:29:40.835927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:29:40.837802 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f029a8bb389c4d348c0e9001c5fa059c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f029a8bb389c4d348c0e9001c5fa059c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f029a8bb389c4d348c0e9001c5fa059c", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f029a8bb389c4d348c0e9001c5fa059c"}]}] Jun 16 17:29:40.837802 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:29:40.837802 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: f029a8bb389c4d348c0e9001c5fa059c Jun 16 17:29:40.837802 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:29:40.837802 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-AttachVolumeTestJSON-336390128-project Jun 16 17:29:40.837802 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:29:40.837802 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:29:40.837802 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: 1a3418bd5d7f430ca84efd5c83e38fed Jun 16 17:29:40.837802 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-AttachVolumeTestJSON-336390128-project Jun 16 17:29:40.837802 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:29:40.837802 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. Jun 16 17:29:40.837802 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': 'aeb07519-2ce6-44ee-a88c-d46b4e11b367'} Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:29:40.838740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. Jun 16 17:29:40.840356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:29:40.842015 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-65857571-2001-4aa9-b751-82d310f4dbd5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Returning 404 to user: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:29:40.857739 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-65857571-2001-4aa9-b751-82d310f4dbd5 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "DELETE /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 404 len: 111 microversion: 2.1 time: 0.086424 Jun 16 17:29:40.859056 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 404/808] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:29:40 2022] DELETE /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:29:40.868183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ea3ecb22-a819-4b0e-9974-06e8947378e3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:40.869342 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ea3ecb22-a819-4b0e-9974-06e8947378e3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:40.883972 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ea3ecb22-a819-4b0e-9974-06e8947378e3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:40.884852 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ea3ecb22-a819-4b0e-9974-06e8947378e3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:40.886831 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ea3ecb22-a819-4b0e-9974-06e8947378e3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:40.889344 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ea3ecb22-a819-4b0e-9974-06e8947378e3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:40.889959 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d226f3d4-23c1-4ae3-82ab-d534c60f4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:40.890587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-d226f3d4-23c1-4ae3-82ab-d534c60f4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: aeb07519-2ce6-44ee-a88c-d46b4e11b367] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:40.906465 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d226f3d4-23c1-4ae3-82ab-d534c60f4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:40.906917 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d226f3d4-23c1-4ae3-82ab-d534c60f4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:40.907759 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d226f3d4-23c1-4ae3-82ab-d534c60f4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:40.908279 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d226f3d4-23c1-4ae3-82ab-d534c60f4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:40.942480 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-d226f3d4-23c1-4ae3-82ab-d534c60f4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] HTTP exception thrown: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d226f3d4-23c1-4ae3-82ab-d534c60f4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Request method failure captured: Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 HTTP/1.1 Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2beuWk7EZlEjA9yRMTDbNejBZxpiStz8muB1t5YfyUNjOp366FElg-CGG7YxZd-LPYYcDXJpDnt37xIZKURu01Wg9u2dzkYnziyBT6e1zA88cgUmblIzeM6q8-Ibj73wyofaPbdJ0KQJkVcnySSy9zuDYNkRjPIMYbkXjjXewjdmZU Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: f029a8bb389c4d348c0e9001c5fa059c Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:29:40.944002 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:29:40.946431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f029a8bb389c4d348c0e9001c5fa059c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f029a8bb389c4d348c0e9001c5fa059c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f029a8bb389c4d348c0e9001c5fa059c", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f029a8bb389c4d348c0e9001c5fa059c"}]}] Jun 16 17:29:40.946431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:29:40.946431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: f029a8bb389c4d348c0e9001c5fa059c Jun 16 17:29:40.946431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:29:40.946431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-AttachVolumeTestJSON-336390128-project Jun 16 17:29:40.946431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:29:40.946431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:29:40.946431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: 1a3418bd5d7f430ca84efd5c83e38fed Jun 16 17:29:40.946431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-AttachVolumeTestJSON-336390128-project Jun 16 17:29:40.946431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:29:40.946431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. Jun 16 17:29:40.946431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': 'aeb07519-2ce6-44ee-a88c-d46b4e11b367'} Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:29:40.947770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. Jun 16 17:29:40.949751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:29:40.951375 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d226f3d4-23c1-4ae3-82ab-d534c60f4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Returning 404 to user: Instance aeb07519-2ce6-44ee-a88c-d46b4e11b367 could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:29:40.951375 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-d226f3d4-23c1-4ae3-82ab-d534c60f4fcf tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367" status: 404 len: 111 microversion: 2.1 time: 0.074995 Jun 16 17:29:40.975723 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 405/809] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:40 2022] GET /compute/v2.1/servers/aeb07519-2ce6-44ee-a88c-d46b4e11b367 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:29:41.343539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2642402e-228c-48b4-993f-51967a378b3b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:41.344848 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2642402e-228c-48b4-993f-51967a378b3b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:41.362559 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2642402e-228c-48b4-993f-51967a378b3b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:41.363463 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2642402e-228c-48b4-993f-51967a378b3b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:41.368258 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2642402e-228c-48b4-993f-51967a378b3b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:41.370675 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2642402e-228c-48b4-993f-51967a378b3b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:41.841626 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2642402e-228c-48b4-993f-51967a378b3b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:41.867837 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2642402e-228c-48b4-993f-51967a378b3b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1266 microversion: 2.1 time: 0.525583 Jun 16 17:29:41.870339 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 406/810] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:41 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1266 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:29:42.114545 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ea3ecb22-a819-4b0e-9974-06e8947378e3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:42.141390 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ea3ecb22-a819-4b0e-9974-06e8947378e3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:42.142097 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ea3ecb22-a819-4b0e-9974-06e8947378e3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:42.147352 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ea3ecb22-a819-4b0e-9974-06e8947378e3 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1730 microversion: 2.20 time: 1.282161 Jun 16 17:29:42.148769 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 405/811] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:40 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1730 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:42.309055 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-102e7900-0100-417c-a888-bf3e74667e70 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:42.309654 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-102e7900-0100-417c-a888-bf3e74667e70 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:42.323630 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-102e7900-0100-417c-a888-bf3e74667e70 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:42.324210 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-102e7900-0100-417c-a888-bf3e74667e70 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:42.325042 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-102e7900-0100-417c-a888-bf3e74667e70 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:42.325501 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-102e7900-0100-417c-a888-bf3e74667e70 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:42.365660 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-102e7900-0100-417c-a888-bf3e74667e70 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] HTTP exception thrown: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-102e7900-0100-417c-a888-bf3e74667e70 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Request method failure captured: Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: DELETE /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 HTTP/1.1 Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2beuWk7EZlEjA9yRMTDbNejBZxpiStz8muB1t5YfyUNjOp366FElg-CGG7YxZd-LPYYcDXJpDnt37xIZKURu01Wg9u2dzkYnziyBT6e1zA88cgUmblIzeM6q8-Ibj73wyofaPbdJ0KQJkVcnySSy9zuDYNkRjPIMYbkXjjXewjdmZU Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: f029a8bb389c4d348c0e9001c5fa059c Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:29:42.367603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:29:42.369069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f029a8bb389c4d348c0e9001c5fa059c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f029a8bb389c4d348c0e9001c5fa059c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f029a8bb389c4d348c0e9001c5fa059c", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f029a8bb389c4d348c0e9001c5fa059c"}]}] Jun 16 17:29:42.369069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:29:42.369069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: f029a8bb389c4d348c0e9001c5fa059c Jun 16 17:29:42.369069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:29:42.369069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-AttachVolumeTestJSON-336390128-project Jun 16 17:29:42.369069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:29:42.369069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:29:42.369069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: 1a3418bd5d7f430ca84efd5c83e38fed Jun 16 17:29:42.369069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-AttachVolumeTestJSON-336390128-project Jun 16 17:29:42.369069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:29:42.369069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. Jun 16 17:29:42.369069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': '7d22b60d-19fe-4dca-8eef-821db5a4dc55'} Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:29:42.370173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. Jun 16 17:29:42.371589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:29:42.372913 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-102e7900-0100-417c-a888-bf3e74667e70 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Returning 404 to user: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:29:42.372913 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-102e7900-0100-417c-a888-bf3e74667e70 tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 404 len: 111 microversion: 2.1 time: 0.067307 Jun 16 17:29:42.380991 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9bc902af-1144-49bb-a3b0-61ed6e8e432a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:42.381489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 407/812] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:29:42 2022] DELETE /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:29:42.382316 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-9bc902af-1144-49bb-a3b0-61ed6e8e432a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] [instance: 7d22b60d-19fe-4dca-8eef-821db5a4dc55] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:42.397751 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9bc902af-1144-49bb-a3b0-61ed6e8e432a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:42.398186 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9bc902af-1144-49bb-a3b0-61ed6e8e432a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:42.399045 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9bc902af-1144-49bb-a3b0-61ed6e8e432a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:42.400876 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9bc902af-1144-49bb-a3b0-61ed6e8e432a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:42.436058 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-9bc902af-1144-49bb-a3b0-61ed6e8e432a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] HTTP exception thrown: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9bc902af-1144-49bb-a3b0-61ed6e8e432a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Request method failure captured: Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 HTTP/1.1 Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2beuWk7EZlEjA9yRMTDbNejBZxpiStz8muB1t5YfyUNjOp366FElg-CGG7YxZd-LPYYcDXJpDnt37xIZKURu01Wg9u2dzkYnziyBT6e1zA88cgUmblIzeM6q8-Ibj73wyofaPbdJ0KQJkVcnySSy9zuDYNkRjPIMYbkXjjXewjdmZU Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: f029a8bb389c4d348c0e9001c5fa059c Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:29:42.441259 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:29:42.444616 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f029a8bb389c4d348c0e9001c5fa059c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f029a8bb389c4d348c0e9001c5fa059c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f029a8bb389c4d348c0e9001c5fa059c", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f029a8bb389c4d348c0e9001c5fa059c"}]}] Jun 16 17:29:42.444616 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:29:42.444616 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: f029a8bb389c4d348c0e9001c5fa059c Jun 16 17:29:42.444616 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-AttachVolumeTestJSON-336390128 Jun 16 17:29:42.444616 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-AttachVolumeTestJSON-336390128-project Jun 16 17:29:42.444616 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:29:42.444616 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:29:42.444616 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 1a3418bd5d7f430ca84efd5c83e38fed Jun 16 17:29:42.444616 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-AttachVolumeTestJSON-336390128-project Jun 16 17:29:42.444616 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:29:42.444616 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. Jun 16 17:29:42.444616 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': '7d22b60d-19fe-4dca-8eef-821db5a4dc55'} Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:29:42.445685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. Jun 16 17:29:42.447182 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:29:42.450755 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9bc902af-1144-49bb-a3b0-61ed6e8e432a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] Returning 404 to user: Instance 7d22b60d-19fe-4dca-8eef-821db5a4dc55 could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:29:42.451987 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9bc902af-1144-49bb-a3b0-61ed6e8e432a tempest-AttachVolumeTestJSON-336390128 tempest-AttachVolumeTestJSON-336390128-project] 10.222.0.66 "GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55" status: 404 len: 111 microversion: 2.1 time: 0.076338 Jun 16 17:29:42.478251 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 406/813] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:42 2022] GET /compute/v2.1/servers/7d22b60d-19fe-4dca-8eef-821db5a4dc55 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:29:42.902173 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-e41ea5ac-4644-4a66-9b10-9411a655ea7b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:42.904303 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-e41ea5ac-4644-4a66-9b10-9411a655ea7b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:42.950050 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e41ea5ac-4644-4a66-9b10-9411a655ea7b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:42.952330 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e41ea5ac-4644-4a66-9b10-9411a655ea7b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:42.953727 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e41ea5ac-4644-4a66-9b10-9411a655ea7b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:42.954338 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e41ea5ac-4644-4a66-9b10-9411a655ea7b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:43.172400 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a27654d2-11d6-48de-8504-4b7ace9df6f2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:43.173097 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a27654d2-11d6-48de-8504-4b7ace9df6f2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:43.209658 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a27654d2-11d6-48de-8504-4b7ace9df6f2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:43.212489 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a27654d2-11d6-48de-8504-4b7ace9df6f2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:43.218439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a27654d2-11d6-48de-8504-4b7ace9df6f2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:43.218946 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a27654d2-11d6-48de-8504-4b7ace9df6f2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:43.434610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e41ea5ac-4644-4a66-9b10-9411a655ea7b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:43.447137 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-e41ea5ac-4644-4a66-9b10-9411a655ea7b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1453 microversion: 2.1 time: 0.560647 Jun 16 17:29:43.447734 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 408/814] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:42 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1453 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:43.469898 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ee933e2b-4db3-4237-9e81-86fda73e503d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:43.471074 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ee933e2b-4db3-4237-9e81-86fda73e503d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:43.492170 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ee933e2b-4db3-4237-9e81-86fda73e503d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:43.492615 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ee933e2b-4db3-4237-9e81-86fda73e503d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:43.500723 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ee933e2b-4db3-4237-9e81-86fda73e503d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:43.501733 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ee933e2b-4db3-4237-9e81-86fda73e503d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:43.673074 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a27654d2-11d6-48de-8504-4b7ace9df6f2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:43.688840 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a27654d2-11d6-48de-8504-4b7ace9df6f2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:43.690894 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a27654d2-11d6-48de-8504-4b7ace9df6f2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:43.692456 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a27654d2-11d6-48de-8504-4b7ace9df6f2 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1730 microversion: 2.20 time: 0.526257 Jun 16 17:29:43.693467 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 407/815] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:43 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1730 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:29:43.890902 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ee933e2b-4db3-4237-9e81-86fda73e503d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:43.909447 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ee933e2b-4db3-4237-9e81-86fda73e503d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1453 microversion: 2.1 time: 0.444502 Jun 16 17:29:43.925211 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 409/816] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:29:43 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1453 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:29:44.711225 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e9b22aae-7632-448d-8d87-e4f570ea0845 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:44.712468 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e9b22aae-7632-448d-8d87-e4f570ea0845 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:44.719513 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e9b22aae-7632-448d-8d87-e4f570ea0845 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:44.720224 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e9b22aae-7632-448d-8d87-e4f570ea0845 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:44.721344 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e9b22aae-7632-448d-8d87-e4f570ea0845 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:44.721947 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e9b22aae-7632-448d-8d87-e4f570ea0845 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:44.967288 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-e9b22aae-7632-448d-8d87-e4f570ea0845 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:44.994692 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-e9b22aae-7632-448d-8d87-e4f570ea0845 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:44.997599 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-e9b22aae-7632-448d-8d87-e4f570ea0845 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:44.999747 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-e9b22aae-7632-448d-8d87-e4f570ea0845 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1730 microversion: 2.20 time: 0.292177 Jun 16 17:29:45.029663 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 408/817] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:44 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1730 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:46.027665 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-af6a6ae8-4b7e-4896-93e8-562b6e3ff613 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:46.029289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-af6a6ae8-4b7e-4896-93e8-562b6e3ff613 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:46.037453 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-af6a6ae8-4b7e-4896-93e8-562b6e3ff613 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:46.038609 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-af6a6ae8-4b7e-4896-93e8-562b6e3ff613 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:46.040083 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-af6a6ae8-4b7e-4896-93e8-562b6e3ff613 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:46.040666 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-af6a6ae8-4b7e-4896-93e8-562b6e3ff613 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:46.809532 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-af6a6ae8-4b7e-4896-93e8-562b6e3ff613 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:46.828971 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-af6a6ae8-4b7e-4896-93e8-562b6e3ff613 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:46.831033 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-af6a6ae8-4b7e-4896-93e8-562b6e3ff613 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:46.832464 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-af6a6ae8-4b7e-4896-93e8-562b6e3ff613 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1730 microversion: 2.20 time: 0.809101 Jun 16 17:29:46.834632 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 410/818] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:46 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1730 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:47.319889 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-f65a0794-eec8-4dc6-8191-73f4dea6a7ef req-dd3bfe21-8681-4f87-a290-6c24edde8c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4", "name": "network-vif-plugged", "status": "completed", "tag": "8d7a682c-8735-4554-a952-dc548868e5d9"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:29:47.346890 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-f65a0794-eec8-4dc6-8191-73f4dea6a7ef req-dd3bfe21-8681-4f87-a290-6c24edde8c51 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:47.347349 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-f65a0794-eec8-4dc6-8191-73f4dea6a7ef req-dd3bfe21-8681-4f87-a290-6c24edde8c51 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:47.360343 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-f65a0794-eec8-4dc6-8191-73f4dea6a7ef req-dd3bfe21-8681-4f87-a290-6c24edde8c51 service nova] Creating event network-vif-plugged:8d7a682c-8735-4554-a952-dc548868e5d9 for instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 on hv-cinder-83735 Jun 16 17:29:47.383215 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-f65a0794-eec8-4dc6-8191-73f4dea6a7ef req-dd3bfe21-8681-4f87-a290-6c24edde8c51 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067685 Jun 16 17:29:47.384279 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 409/819] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:29:47.865945 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e5f411a1-f9b2-4111-b169-4799c45e540c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:47.866649 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e5f411a1-f9b2-4111-b169-4799c45e540c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:47.878417 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e5f411a1-f9b2-4111-b169-4799c45e540c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:47.879043 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e5f411a1-f9b2-4111-b169-4799c45e540c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:47.880417 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e5f411a1-f9b2-4111-b169-4799c45e540c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:47.881036 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e5f411a1-f9b2-4111-b169-4799c45e540c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:48.174216 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-e5f411a1-f9b2-4111-b169-4799c45e540c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:48.187387 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-e5f411a1-f9b2-4111-b169-4799c45e540c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:48.193763 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-e5f411a1-f9b2-4111-b169-4799c45e540c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:48.202745 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-e5f411a1-f9b2-4111-b169-4799c45e540c tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1730 microversion: 2.20 time: 0.341460 Jun 16 17:29:48.203073 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 410/820] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:47 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1730 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:48.207897 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-6fd7001c-6872-4061-94b1-7d8d11aaef6f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Action: 'create', calling method: .version_select at 0x7f66b16ede50>, body: {"keypair": {"name": "tempest-TestShelveInstance-632486400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEsO0OKl7WSGvMpD8gliL1W2LbDirzcioY1Haq5FLZ8nqPMvJge10AKNj0Q0wbnl8V/yzxn/XuH10MedfyA6a6ZmCcG6R8S3D/s+A90oRKugG+Vvi+YLp/nQF+lGOur8Q=="}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:29:48.239698 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-6fd7001c-6872-4061-94b1-7d8d11aaef6f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Getting quotas for project 50aeadccaa9348fd9af173f94291bf6f. Resources: {'key_pairs'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:29:48.246009 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-6fd7001c-6872-4061-94b1-7d8d11aaef6f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Getting quotas for user 6cd1d0ce941845c3a28e2cd5fc77c844 and project 50aeadccaa9348fd9af173f94291bf6f. Resources: {'key_pairs'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:29:48.287149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-6fd7001c-6872-4061-94b1-7d8d11aaef6f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.425827 Jun 16 17:29:48.289062 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 411/821] 10.222.0.66 () {60 vars in 1158 bytes} [Thu Jun 16 17:29:47 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:29:48.773942 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-42caa8b6-c7fe-4c82-999e-16693eab3088 req-f9c6057b-2996-4e8b-b037-b0ea51c45dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5b6345-48fe-44a0-b917-2b12902e234b", "tag": "ccefb110-1f8f-47f6-a66f-5a8c5114a8dc"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:29:48.789300 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-42caa8b6-c7fe-4c82-999e-16693eab3088 req-f9c6057b-2996-4e8b-b037-b0ea51c45dd0 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:48.789753 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-42caa8b6-c7fe-4c82-999e-16693eab3088 req-f9c6057b-2996-4e8b-b037-b0ea51c45dd0 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:48.827592 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-42caa8b6-c7fe-4c82-999e-16693eab3088 req-f9c6057b-2996-4e8b-b037-b0ea51c45dd0 service nova] Creating event network-changed:ccefb110-1f8f-47f6-a66f-5a8c5114a8dc for instance ce5b6345-48fe-44a0-b917-2b12902e234b on hv-cinder-83735 Jun 16 17:29:48.846595 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-42caa8b6-c7fe-4c82-999e-16693eab3088 req-f9c6057b-2996-4e8b-b037-b0ea51c45dd0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075890 Jun 16 17:29:48.848028 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 411/822] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:29:49.221195 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-41fbe6f9-8bd0-48ad-b817-0622aed2af75 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:49.221814 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-41fbe6f9-8bd0-48ad-b817-0622aed2af75 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:49.248508 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-41fbe6f9-8bd0-48ad-b817-0622aed2af75 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:49.250376 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-41fbe6f9-8bd0-48ad-b817-0622aed2af75 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:49.251599 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-41fbe6f9-8bd0-48ad-b817-0622aed2af75 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:49.264725 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-41fbe6f9-8bd0-48ad-b817-0622aed2af75 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:49.269651 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:50.262087 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-41fbe6f9-8bd0-48ad-b817-0622aed2af75 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:50.275283 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-41fbe6f9-8bd0-48ad-b817-0622aed2af75 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:50.279088 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-41fbe6f9-8bd0-48ad-b817-0622aed2af75 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:50.281546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-41fbe6f9-8bd0-48ad-b817-0622aed2af75 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1730 microversion: 2.20 time: 1.065271 Jun 16 17:29:50.286567 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 412/823] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:49 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1730 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:29:51.303770 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-215690ad-cde9-48d4-9e38-65a33418291b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:29:51.304754 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-215690ad-cde9-48d4-9e38-65a33418291b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:29:51.323806 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-215690ad-cde9-48d4-9e38-65a33418291b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:51.324254 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-215690ad-cde9-48d4-9e38-65a33418291b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:51.325046 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-215690ad-cde9-48d4-9e38-65a33418291b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:29:51.325501 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-215690ad-cde9-48d4-9e38-65a33418291b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:29:51.623086 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-215690ad-cde9-48d4-9e38-65a33418291b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:51.636873 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-215690ad-cde9-48d4-9e38-65a33418291b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:51.640283 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-215690ad-cde9-48d4-9e38-65a33418291b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:29:51.642444 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-215690ad-cde9-48d4-9e38-65a33418291b tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1717 microversion: 2.20 time: 0.343788 Jun 16 17:29:51.643207 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 412/824] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:29:51 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1717 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:30:08.069103 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-269bdd74-08ad-4c51-a9f6-5e0f4546be2b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1448736193", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-632486400", "security_groups": [{"name": "tempest-secgroup-smoke-1742550529"}], "networks": [{"uuid": "e2e2bf0f-54ad-46f0-9611-04e943388552"}], "block_device_mapping_v2": [{"uuid": "c34c293c-a717-48f4-8cc6-e8420c7ce6b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:30:08.077549 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=4 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:08.078455 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:08.079086 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=4 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:08.225247 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.network.neutron [None req-269bdd74-08ad-4c51-a9f6-5e0f4546be2b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] validate_networks() for [('e2e2bf0f-54ad-46f0-9611-04e943388552', None, None, None, None, None)] {{(pid=117553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:30:08.732689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-269bdd74-08ad-4c51-a9f6-5e0f4546be2b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Flavor limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:30:08.733388 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-269bdd74-08ad-4c51-a9f6-5e0f4546be2b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Image limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:30:08.734090 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-269bdd74-08ad-4c51-a9f6-5e0f4546be2b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Flavor pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:30:08.734596 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-269bdd74-08ad-4c51-a9f6-5e0f4546be2b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Image pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:30:08.735012 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-269bdd74-08ad-4c51-a9f6-5e0f4546be2b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:30:08.746174 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-269bdd74-08ad-4c51-a9f6-5e0f4546be2b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:08.746623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-269bdd74-08ad-4c51-a9f6-5e0f4546be2b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:08.747439 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-269bdd74-08ad-4c51-a9f6-5e0f4546be2b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:08.747861 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-269bdd74-08ad-4c51-a9f6-5e0f4546be2b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:08.769474 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-269bdd74-08ad-4c51-a9f6-5e0f4546be2b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Getting quotas for project 50aeadccaa9348fd9af173f94291bf6f. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:30:08.775748 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-269bdd74-08ad-4c51-a9f6-5e0f4546be2b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Getting quotas for user 6cd1d0ce941845c3a28e2cd5fc77c844 and project 50aeadccaa9348fd9af173f94291bf6f. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:30:08.852236 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-269bdd74-08ad-4c51-a9f6-5e0f4546be2b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Going to run 1 instances... {{(pid=117553) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:30:08.854412 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-269bdd74-08ad-4c51-a9f6-5e0f4546be2b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c34c293c-a717-48f4-8cc6-e8420c7ce6b2',volume_size=None,volume_type=None)] {{(pid=117553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:30:09.065526 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-269bdd74-08ad-4c51-a9f6-5e0f4546be2b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.001156 Jun 16 17:30:09.067099 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 413/825] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:30:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:30:09.085659 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-52a9ab6d-49d1-49d0-982d-7b3e261dcb8d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:09.086772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-52a9ab6d-49d1-49d0-982d-7b3e261dcb8d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:09.092930 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:09.093964 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=85 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:09.160227 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-52a9ab6d-49d1-49d0-982d-7b3e261dcb8d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:09.172311 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-52a9ab6d-49d1-49d0-982d-7b3e261dcb8d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1088 microversion: 2.1 time: 0.098861 Jun 16 17:30:09.172939 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 413/826] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:09 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1088 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:10.189597 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d76ee652-6aab-4f03-87d3-e52663e5d3a7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:10.190898 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-d76ee652-6aab-4f03-87d3-e52663e5d3a7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:10.199243 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d76ee652-6aab-4f03-87d3-e52663e5d3a7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:10.200089 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d76ee652-6aab-4f03-87d3-e52663e5d3a7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:10.201080 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d76ee652-6aab-4f03-87d3-e52663e5d3a7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:10.201761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d76ee652-6aab-4f03-87d3-e52663e5d3a7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:10.298744 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d76ee652-6aab-4f03-87d3-e52663e5d3a7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:10.309624 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-d76ee652-6aab-4f03-87d3-e52663e5d3a7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1194 microversion: 2.1 time: 0.124703 Jun 16 17:30:10.310232 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 414/827] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:10 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1194 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:11.328705 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d1e92444-c66f-4925-ba03-315f0062af67 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:11.329368 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d1e92444-c66f-4925-ba03-315f0062af67 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:11.337580 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d1e92444-c66f-4925-ba03-315f0062af67 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:11.338033 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d1e92444-c66f-4925-ba03-315f0062af67 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:11.339078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d1e92444-c66f-4925-ba03-315f0062af67 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:11.339463 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d1e92444-c66f-4925-ba03-315f0062af67 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:11.955962 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d1e92444-c66f-4925-ba03-315f0062af67 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:11.967082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d1e92444-c66f-4925-ba03-315f0062af67 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1260 microversion: 2.1 time: 0.642498 Jun 16 17:30:11.967469 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 414/828] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:11 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1260 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:12.368465 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-e2633c27-08bd-41dd-92b1-b7cb5e9b5f0a req-266c6e2c-02e0-4111-b3e7-425926e0ee06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc6f984-945e-4244-b25d-45c9022782dd", "tag": "9ab6739f-6b37-443b-9a2c-8dc7f323433a"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:30:12.384460 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-e2633c27-08bd-41dd-92b1-b7cb5e9b5f0a req-266c6e2c-02e0-4111-b3e7-425926e0ee06 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:12.395297 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-e2633c27-08bd-41dd-92b1-b7cb5e9b5f0a req-266c6e2c-02e0-4111-b3e7-425926e0ee06 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:12.414355 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-e2633c27-08bd-41dd-92b1-b7cb5e9b5f0a req-266c6e2c-02e0-4111-b3e7-425926e0ee06 service nova] Creating event network-changed:9ab6739f-6b37-443b-9a2c-8dc7f323433a for instance 1cc6f984-945e-4244-b25d-45c9022782dd on hv-cinder-83735 Jun 16 17:30:12.420682 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-e2633c27-08bd-41dd-92b1-b7cb5e9b5f0a req-266c6e2c-02e0-4111-b3e7-425926e0ee06 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058312 Jun 16 17:30:12.421994 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 415/829] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:30:12.988558 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e92cc880-f90a-4367-b6d1-0c43a3587c9b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:12.991102 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e92cc880-f90a-4367-b6d1-0c43a3587c9b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:13.002332 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e92cc880-f90a-4367-b6d1-0c43a3587c9b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:13.003229 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e92cc880-f90a-4367-b6d1-0c43a3587c9b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:13.004770 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e92cc880-f90a-4367-b6d1-0c43a3587c9b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:13.005892 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e92cc880-f90a-4367-b6d1-0c43a3587c9b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:13.233205 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-e92cc880-f90a-4367-b6d1-0c43a3587c9b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:13.242959 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-e92cc880-f90a-4367-b6d1-0c43a3587c9b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1260 microversion: 2.1 time: 0.261207 Jun 16 17:30:13.243977 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 415/830] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:12 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1260 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:14.262943 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-57fcedf0-ca11-4d1c-bca0-28fd85c83b08 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:14.263771 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-57fcedf0-ca11-4d1c-bca0-28fd85c83b08 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:14.271546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-57fcedf0-ca11-4d1c-bca0-28fd85c83b08 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:14.272142 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-57fcedf0-ca11-4d1c-bca0-28fd85c83b08 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:14.273028 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-57fcedf0-ca11-4d1c-bca0-28fd85c83b08 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:14.273627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-57fcedf0-ca11-4d1c-bca0-28fd85c83b08 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:14.420169 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-57fcedf0-ca11-4d1c-bca0-28fd85c83b08 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:14.431085 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-57fcedf0-ca11-4d1c-bca0-28fd85c83b08 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1260 microversion: 2.1 time: 0.173459 Jun 16 17:30:14.432087 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 416/831] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:14 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:15.449908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8c28386f-25a9-44dd-8712-646bfb8fd422 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:15.450595 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8c28386f-25a9-44dd-8712-646bfb8fd422 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:15.459051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8c28386f-25a9-44dd-8712-646bfb8fd422 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:15.459487 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8c28386f-25a9-44dd-8712-646bfb8fd422 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:15.460276 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8c28386f-25a9-44dd-8712-646bfb8fd422 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:15.460693 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8c28386f-25a9-44dd-8712-646bfb8fd422 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:15.614921 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8c28386f-25a9-44dd-8712-646bfb8fd422 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:15.624557 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8c28386f-25a9-44dd-8712-646bfb8fd422 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1260 microversion: 2.1 time: 0.178552 Jun 16 17:30:15.625150 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 416/832] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:15 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:16.642816 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-58e16aed-339b-42f6-bb46-ddf174ae868a tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:16.643715 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-58e16aed-339b-42f6-bb46-ddf174ae868a tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:16.650740 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-58e16aed-339b-42f6-bb46-ddf174ae868a tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:16.651201 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-58e16aed-339b-42f6-bb46-ddf174ae868a tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:16.651971 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-58e16aed-339b-42f6-bb46-ddf174ae868a tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:16.652388 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-58e16aed-339b-42f6-bb46-ddf174ae868a tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:16.810582 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-58e16aed-339b-42f6-bb46-ddf174ae868a tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:16.821066 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-58e16aed-339b-42f6-bb46-ddf174ae868a tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1260 microversion: 2.1 time: 0.181573 Jun 16 17:30:16.821920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 417/833] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:16 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:17.843383 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a2b2ca2b-2c75-4f2c-9482-ee06d4b5a3fb tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:17.843936 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a2b2ca2b-2c75-4f2c-9482-ee06d4b5a3fb tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:17.851072 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a2b2ca2b-2c75-4f2c-9482-ee06d4b5a3fb tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:17.851522 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a2b2ca2b-2c75-4f2c-9482-ee06d4b5a3fb tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:17.852286 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a2b2ca2b-2c75-4f2c-9482-ee06d4b5a3fb tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:17.852718 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a2b2ca2b-2c75-4f2c-9482-ee06d4b5a3fb tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:18.004819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a2b2ca2b-2c75-4f2c-9482-ee06d4b5a3fb tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:18.012984 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a2b2ca2b-2c75-4f2c-9482-ee06d4b5a3fb tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1260 microversion: 2.1 time: 0.173618 Jun 16 17:30:18.013583 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 417/834] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:17 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:19.030056 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-1e4ca0ba-4afc-439b-9d5c-ca0f97f74e02 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:19.030653 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-1e4ca0ba-4afc-439b-9d5c-ca0f97f74e02 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:19.033105 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:19.033801 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=6 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:19.040518 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1e4ca0ba-4afc-439b-9d5c-ca0f97f74e02 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:19.040957 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1e4ca0ba-4afc-439b-9d5c-ca0f97f74e02 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:19.041752 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1e4ca0ba-4afc-439b-9d5c-ca0f97f74e02 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:19.042176 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1e4ca0ba-4afc-439b-9d5c-ca0f97f74e02 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:19.193032 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-1e4ca0ba-4afc-439b-9d5c-ca0f97f74e02 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:19.200819 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-1e4ca0ba-4afc-439b-9d5c-ca0f97f74e02 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1260 microversion: 2.1 time: 0.174624 Jun 16 17:30:19.201397 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 418/835] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:19 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:20.221371 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-31ced508-3197-4575-81aa-0826d6b73c23 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:20.221980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-31ced508-3197-4575-81aa-0826d6b73c23 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:20.224799 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:20.231643 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-31ced508-3197-4575-81aa-0826d6b73c23 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:20.232076 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-31ced508-3197-4575-81aa-0826d6b73c23 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:20.232840 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-31ced508-3197-4575-81aa-0826d6b73c23 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:20.233291 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-31ced508-3197-4575-81aa-0826d6b73c23 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:20.377300 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-31ced508-3197-4575-81aa-0826d6b73c23 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:20.385211 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-31ced508-3197-4575-81aa-0826d6b73c23 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1260 microversion: 2.1 time: 0.170133 Jun 16 17:30:20.385787 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 418/836] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:20 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:21.405512 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-46f881cc-a694-4ace-b379-74885544ca1e tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:21.406077 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-46f881cc-a694-4ace-b379-74885544ca1e tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:21.413643 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-46f881cc-a694-4ace-b379-74885544ca1e tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:21.414089 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-46f881cc-a694-4ace-b379-74885544ca1e tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:21.414857 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-46f881cc-a694-4ace-b379-74885544ca1e tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:21.415280 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-46f881cc-a694-4ace-b379-74885544ca1e tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:21.564807 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-46f881cc-a694-4ace-b379-74885544ca1e tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:21.573522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-46f881cc-a694-4ace-b379-74885544ca1e tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1260 microversion: 2.1 time: 0.171916 Jun 16 17:30:21.574107 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 419/837] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:21 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:22.591366 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f6de53a0-0b4f-4316-9cf5-75f13e7777e5 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:22.591968 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f6de53a0-0b4f-4316-9cf5-75f13e7777e5 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:22.598825 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f6de53a0-0b4f-4316-9cf5-75f13e7777e5 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:22.599355 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f6de53a0-0b4f-4316-9cf5-75f13e7777e5 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:22.600134 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f6de53a0-0b4f-4316-9cf5-75f13e7777e5 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:22.600564 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f6de53a0-0b4f-4316-9cf5-75f13e7777e5 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:22.750586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f6de53a0-0b4f-4316-9cf5-75f13e7777e5 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:22.759097 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f6de53a0-0b4f-4316-9cf5-75f13e7777e5 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1260 microversion: 2.1 time: 0.171337 Jun 16 17:30:22.759858 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 419/838] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:22 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:23.770618 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-dd0b4708-ff33-4411-a5de-4d0cc851ebdc req-70f01072-7ea6-4997-a2e9-da476bb1e037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc6f984-945e-4244-b25d-45c9022782dd", "name": "network-vif-plugged", "status": "completed", "tag": "9ab6739f-6b37-443b-9a2c-8dc7f323433a"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:30:23.780540 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-dd0b4708-ff33-4411-a5de-4d0cc851ebdc req-70f01072-7ea6-4997-a2e9-da476bb1e037 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:23.781003 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-dd0b4708-ff33-4411-a5de-4d0cc851ebdc req-70f01072-7ea6-4997-a2e9-da476bb1e037 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:23.783584 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ebc2e9fd-e1bc-4653-9bfa-4d9136d27c97 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:23.784373 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ebc2e9fd-e1bc-4653-9bfa-4d9136d27c97 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:23.791779 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ebc2e9fd-e1bc-4653-9bfa-4d9136d27c97 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:23.792551 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ebc2e9fd-e1bc-4653-9bfa-4d9136d27c97 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:23.793608 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ebc2e9fd-e1bc-4653-9bfa-4d9136d27c97 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:23.794204 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ebc2e9fd-e1bc-4653-9bfa-4d9136d27c97 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:23.795017 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-dd0b4708-ff33-4411-a5de-4d0cc851ebdc req-70f01072-7ea6-4997-a2e9-da476bb1e037 service nova] Creating event network-vif-plugged:9ab6739f-6b37-443b-9a2c-8dc7f323433a for instance 1cc6f984-945e-4244-b25d-45c9022782dd on hv-cinder-83735 Jun 16 17:30:23.800538 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-dd0b4708-ff33-4411-a5de-4d0cc851ebdc req-70f01072-7ea6-4997-a2e9-da476bb1e037 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033977 Jun 16 17:30:23.801313 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 420/839] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:30:23.949031 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ebc2e9fd-e1bc-4653-9bfa-4d9136d27c97 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:23.956906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ebc2e9fd-e1bc-4653-9bfa-4d9136d27c97 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1260 microversion: 2.1 time: 0.177458 Jun 16 17:30:23.966123 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 420/840] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:23 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:24.975421 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-474a6df0-7b2f-4eb1-bce0-128a35b20668 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:24.976813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-474a6df0-7b2f-4eb1-bce0-128a35b20668 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:24.983273 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-474a6df0-7b2f-4eb1-bce0-128a35b20668 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:24.983696 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-474a6df0-7b2f-4eb1-bce0-128a35b20668 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:24.984505 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-474a6df0-7b2f-4eb1-bce0-128a35b20668 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:24.985011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-474a6df0-7b2f-4eb1-bce0-128a35b20668 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:25.139022 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-474a6df0-7b2f-4eb1-bce0-128a35b20668 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:25.147886 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-474a6df0-7b2f-4eb1-bce0-128a35b20668 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1260 microversion: 2.1 time: 0.177665 Jun 16 17:30:25.149573 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 421/841] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:24 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:26.167658 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5ca5411b-5c04-4438-8a51-e41393c4eb34 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:26.168561 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-5ca5411b-5c04-4438-8a51-e41393c4eb34 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:26.178844 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5ca5411b-5c04-4438-8a51-e41393c4eb34 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:26.179304 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5ca5411b-5c04-4438-8a51-e41393c4eb34 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:26.180223 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5ca5411b-5c04-4438-8a51-e41393c4eb34 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:26.180852 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5ca5411b-5c04-4438-8a51-e41393c4eb34 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:26.329002 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5ca5411b-5c04-4438-8a51-e41393c4eb34 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:26.338369 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-5ca5411b-5c04-4438-8a51-e41393c4eb34 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1443 microversion: 2.1 time: 0.177159 Jun 16 17:30:26.338939 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 421/842] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:26 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1443 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:26.354967 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-44dfcefe-f1bf-44b9-ba11-97dec7a0ee92 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:26.355585 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-44dfcefe-f1bf-44b9-ba11-97dec7a0ee92 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:26.367393 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-44dfcefe-f1bf-44b9-ba11-97dec7a0ee92 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:26.367820 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-44dfcefe-f1bf-44b9-ba11-97dec7a0ee92 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:26.368594 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-44dfcefe-f1bf-44b9-ba11-97dec7a0ee92 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:26.369026 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-44dfcefe-f1bf-44b9-ba11-97dec7a0ee92 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:26.518918 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-44dfcefe-f1bf-44b9-ba11-97dec7a0ee92 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:26.527272 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-44dfcefe-f1bf-44b9-ba11-97dec7a0ee92 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1443 microversion: 2.1 time: 0.176137 Jun 16 17:30:26.527787 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 422/843] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:26 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1443 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:28.429970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-6d4b614d-2aa0-4b87-aa83-4a7b003d03bd req-e62ccceb-6582-4213-b93a-302bbf8614ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc6f984-945e-4244-b25d-45c9022782dd", "tag": "9ab6739f-6b37-443b-9a2c-8dc7f323433a"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:30:28.444823 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-6d4b614d-2aa0-4b87-aa83-4a7b003d03bd req-e62ccceb-6582-4213-b93a-302bbf8614ae service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:28.445295 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-6d4b614d-2aa0-4b87-aa83-4a7b003d03bd req-e62ccceb-6582-4213-b93a-302bbf8614ae service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:28.456843 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-6d4b614d-2aa0-4b87-aa83-4a7b003d03bd req-e62ccceb-6582-4213-b93a-302bbf8614ae service nova] Creating event network-changed:9ab6739f-6b37-443b-9a2c-8dc7f323433a for instance 1cc6f984-945e-4244-b25d-45c9022782dd on hv-cinder-83735 Jun 16 17:30:28.462406 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-6d4b614d-2aa0-4b87-aa83-4a7b003d03bd req-e62ccceb-6582-4213-b93a-302bbf8614ae service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036138 Jun 16 17:30:28.463035 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 422/844] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:30:33.720184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-13154be0-7e70-4f47-ad20-b8bec00a6344 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:33.721186 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-13154be0-7e70-4f47-ad20-b8bec00a6344 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:33.729068 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-13154be0-7e70-4f47-ad20-b8bec00a6344 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:33.729551 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-13154be0-7e70-4f47-ad20-b8bec00a6344 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:33.730325 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-13154be0-7e70-4f47-ad20-b8bec00a6344 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:33.730756 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-13154be0-7e70-4f47-ad20-b8bec00a6344 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:33.764739 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-13154be0-7e70-4f47-ad20-b8bec00a6344 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049033 Jun 16 17:30:33.765446 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 423/845] 10.222.0.66 () {60 vars in 1342 bytes} [Thu Jun 16 17:30:33 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:33.844800 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-669beec1-f275-4ad3-974f-4931b1123dd9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:33.845449 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-669beec1-f275-4ad3-974f-4931b1123dd9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:33.852508 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-669beec1-f275-4ad3-974f-4931b1123dd9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:33.852956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-669beec1-f275-4ad3-974f-4931b1123dd9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:33.853761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-669beec1-f275-4ad3-974f-4931b1123dd9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:33.854255 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-669beec1-f275-4ad3-974f-4931b1123dd9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:33.884060 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-669beec1-f275-4ad3-974f-4931b1123dd9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Going to try to terminate instance {{(pid=117552) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:30:33.976103 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-669beec1-f275-4ad3-974f-4931b1123dd9 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 204 len: 0 microversion: 2.20 time: 0.136884 Jun 16 17:30:33.976868 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 423/846] 10.222.0.66 () {60 vars in 1279 bytes} [Thu Jun 16 17:30:33 2022] DELETE /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 17:30:33.989951 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7b6cd97f-f1c0-4a0d-8d54-77299e959a31 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:33.990760 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-7b6cd97f-f1c0-4a0d-8d54-77299e959a31 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:33.997340 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7b6cd97f-f1c0-4a0d-8d54-77299e959a31 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:33.997781 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7b6cd97f-f1c0-4a0d-8d54-77299e959a31 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:33.998537 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7b6cd97f-f1c0-4a0d-8d54-77299e959a31 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:33.998959 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7b6cd97f-f1c0-4a0d-8d54-77299e959a31 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:34.135605 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7b6cd97f-f1c0-4a0d-8d54-77299e959a31 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:34.148045 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7b6cd97f-f1c0-4a0d-8d54-77299e959a31 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:34.150291 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7b6cd97f-f1c0-4a0d-8d54-77299e959a31 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:34.152326 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7b6cd97f-f1c0-4a0d-8d54-77299e959a31 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1723 microversion: 2.20 time: 0.169493 Jun 16 17:30:34.153151 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 424/847] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:30:33 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:30:35.178126 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-75466ae6-950b-4150-9c17-3858b0030035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:35.179126 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-75466ae6-950b-4150-9c17-3858b0030035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:35.188019 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-75466ae6-950b-4150-9c17-3858b0030035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:35.188463 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-75466ae6-950b-4150-9c17-3858b0030035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:35.189322 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-75466ae6-950b-4150-9c17-3858b0030035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:35.189899 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-75466ae6-950b-4150-9c17-3858b0030035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:35.379693 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-75466ae6-950b-4150-9c17-3858b0030035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:35.388218 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-75466ae6-950b-4150-9c17-3858b0030035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:35.390839 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-75466ae6-950b-4150-9c17-3858b0030035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:35.392317 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-75466ae6-950b-4150-9c17-3858b0030035 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1723 microversion: 2.20 time: 0.221307 Jun 16 17:30:35.393293 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 424/848] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:30:35 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:30:36.414970 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4b52afb0-1884-4bbb-895b-9d53ad7a4f88 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:36.414970 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4b52afb0-1884-4bbb-895b-9d53ad7a4f88 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:36.420507 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4b52afb0-1884-4bbb-895b-9d53ad7a4f88 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:36.421971 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4b52afb0-1884-4bbb-895b-9d53ad7a4f88 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:36.422901 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4b52afb0-1884-4bbb-895b-9d53ad7a4f88 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:36.423681 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4b52afb0-1884-4bbb-895b-9d53ad7a4f88 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:36.615506 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4b52afb0-1884-4bbb-895b-9d53ad7a4f88 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:36.624156 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4b52afb0-1884-4bbb-895b-9d53ad7a4f88 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:36.625834 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4b52afb0-1884-4bbb-895b-9d53ad7a4f88 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:36.627421 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4b52afb0-1884-4bbb-895b-9d53ad7a4f88 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1723 microversion: 2.20 time: 0.220980 Jun 16 17:30:36.628147 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 425/849] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:30:36 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:30:37.143207 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-21528074-1a89-47cc-b916-6778353add88 req-b170abfa-9288-43c9-8c91-dc6d7f4478f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4", "name": "network-vif-deleted", "tag": "8d7a682c-8735-4554-a952-dc548868e5d9"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:30:37.154151 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-21528074-1a89-47cc-b916-6778353add88 req-b170abfa-9288-43c9-8c91-dc6d7f4478f8 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:37.155324 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-21528074-1a89-47cc-b916-6778353add88 req-b170abfa-9288-43c9-8c91-dc6d7f4478f8 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:37.177829 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-21528074-1a89-47cc-b916-6778353add88 req-b170abfa-9288-43c9-8c91-dc6d7f4478f8 service nova] Creating event network-vif-deleted:8d7a682c-8735-4554-a952-dc548868e5d9 for instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 on hv-cinder-83735 Jun 16 17:30:37.185716 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-21528074-1a89-47cc-b916-6778353add88 req-b170abfa-9288-43c9-8c91-dc6d7f4478f8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046937 Jun 16 17:30:37.190272 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 425/850] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:30:37.649589 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-6472803c-d592-48a3-8a9c-d86726b56fe6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:37.651110 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-6472803c-d592-48a3-8a9c-d86726b56fe6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:37.658888 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6472803c-d592-48a3-8a9c-d86726b56fe6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:37.659338 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6472803c-d592-48a3-8a9c-d86726b56fe6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:37.660511 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6472803c-d592-48a3-8a9c-d86726b56fe6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:37.661697 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6472803c-d592-48a3-8a9c-d86726b56fe6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:37.703284 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6472803c-d592-48a3-8a9c-d86726b56fe6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:37.704162 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6472803c-d592-48a3-8a9c-d86726b56fe6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:37.704650 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.objects.instance [None req-6472803c-d592-48a3-8a9c-d86726b56fe6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lazy-loading 'fault' on Instance uuid a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 {{(pid=117553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:30:37.764151 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6472803c-d592-48a3-8a9c-d86726b56fe6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:37.773550 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6472803c-d592-48a3-8a9c-d86726b56fe6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:37.775065 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6472803c-d592-48a3-8a9c-d86726b56fe6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68da2fd51cc84b2b8d641e1e6ac17c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c63f648631a4a11910b4b135f22b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:37.776255 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-6472803c-d592-48a3-8a9c-d86726b56fe6 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 200 len: 1372 microversion: 2.20 time: 0.132173 Jun 16 17:30:37.789248 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 426/851] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:30:37 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:30:38.796923 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a8ffb07e-b317-424c-b746-901c3f0841e1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:38.799747 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a8ffb07e-b317-424c-b746-901c3f0841e1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:38.809000 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a8ffb07e-b317-424c-b746-901c3f0841e1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:38.809722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a8ffb07e-b317-424c-b746-901c3f0841e1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:38.810498 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a8ffb07e-b317-424c-b746-901c3f0841e1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:38.810922 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a8ffb07e-b317-424c-b746-901c3f0841e1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:38.826103 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-a8ffb07e-b317-424c-b746-901c3f0841e1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] HTTP exception thrown: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a8ffb07e-b317-424c-b746-901c3f0841e1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Request method failure captured: Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 HTTP/1.1 Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2bfTXNo5hz210hfDVTooV9B1XlfPcDbJKJPiY4aZgYrbHAzM2zrs84fJ6e071Btm_k4-ojg7XeO63ExW_kdVhPPh1Cl2HGlD6dBExPO_vKXg7U-KHzqQQpc09nDEA5A77D9smA85likTwu19sn114gA3WCam9FU0n7MCDf73zEyqt8 Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 0c63f648631a4a11910b4b135f22b235 Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:30:38.827767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:30:38.829635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c63f648631a4a11910b4b135f22b235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c63f648631a4a11910b4b135f22b235"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0c63f648631a4a11910b4b135f22b235", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0c63f648631a4a11910b4b135f22b235"}]}] Jun 16 17:30:38.829635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:30:38.829635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 0c63f648631a4a11910b4b135f22b235 Jun 16 17:30:38.829635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:30:38.829635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-AttachVolumeShelveTestJSON-1123487845-project Jun 16 17:30:38.829635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:30:38.829635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:30:38.829635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 68da2fd51cc84b2b8d641e1e6ac17c72 Jun 16 17:30:38.829635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1123487845-project Jun 16 17:30:38.829635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:30:38.829635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. Jun 16 17:30:38.829635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': 'a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4'} Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:30:38.830606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. Jun 16 17:30:38.832013 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:30:38.833487 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a8ffb07e-b317-424c-b746-901c3f0841e1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Returning 404 to user: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:30:38.833487 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a8ffb07e-b317-424c-b746-901c3f0841e1 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 404 len: 111 microversion: 2.20 time: 0.037193 Jun 16 17:30:38.833487 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 426/852] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:30:38 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 17:30:38.840374 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7bb94596-f019-41c2-a764-ed178a4ad489 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '.version_select at 0x7f66b16fe9d0>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:38.849668 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:38.867264 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7bb94596-f019-41c2-a764-ed178a4ad489 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1256609393" status: 204 len: 0 microversion: 2.20 time: 0.030658 Jun 16 17:30:38.868026 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 427/853] 10.222.0.66 () {60 vars in 1261 bytes} [Thu Jun 16 17:30:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1256609393 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 17:30:41.342931 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-27d73d4f-10e1-452d-b995-c8750331dacb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:41.343475 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-27d73d4f-10e1-452d-b995-c8750331dacb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:41.345501 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:41.352057 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-27d73d4f-10e1-452d-b995-c8750331dacb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:41.352371 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-27d73d4f-10e1-452d-b995-c8750331dacb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:41.353165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-27d73d4f-10e1-452d-b995-c8750331dacb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:41.353616 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-27d73d4f-10e1-452d-b995-c8750331dacb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:41.357074 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:41.374767 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-27d73d4f-10e1-452d-b995-c8750331dacb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] HTTP exception thrown: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-27d73d4f-10e1-452d-b995-c8750331dacb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Request method failure captured: Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: DELETE /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 HTTP/1.1 Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2bfTXNo5hz210hfDVTooV9B1XlfPcDbJKJPiY4aZgYrbHAzM2zrs84fJ6e071Btm_k4-ojg7XeO63ExW_kdVhPPh1Cl2HGlD6dBExPO_vKXg7U-KHzqQQpc09nDEA5A77D9smA85likTwu19sn114gA3WCam9FU0n7MCDf73zEyqt8 Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 0c63f648631a4a11910b4b135f22b235 Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:30:41.376447 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:30:41.378538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c63f648631a4a11910b4b135f22b235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c63f648631a4a11910b4b135f22b235"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0c63f648631a4a11910b4b135f22b235", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0c63f648631a4a11910b4b135f22b235"}]}] Jun 16 17:30:41.378538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:30:41.378538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 0c63f648631a4a11910b4b135f22b235 Jun 16 17:30:41.378538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:30:41.378538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-AttachVolumeShelveTestJSON-1123487845-project Jun 16 17:30:41.378538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:30:41.378538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:30:41.378538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 68da2fd51cc84b2b8d641e1e6ac17c72 Jun 16 17:30:41.378538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1123487845-project Jun 16 17:30:41.378538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:30:41.378538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. Jun 16 17:30:41.378538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': 'a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4'} Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:30:41.379374 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. Jun 16 17:30:41.380713 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:30:41.382431 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-27d73d4f-10e1-452d-b995-c8750331dacb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Returning 404 to user: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:30:41.382431 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-27d73d4f-10e1-452d-b995-c8750331dacb tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 404 len: 111 microversion: 2.20 time: 0.039632 Jun 16 17:30:41.382431 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 427/854] 10.222.0.66 () {60 vars in 1279 bytes} [Thu Jun 16 17:30:41 2022] DELETE /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:30:41.388610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f951ae72-e65a-4411-b9b1-0966dc26dfb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:41.389238 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f951ae72-e65a-4411-b9b1-0966dc26dfb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:41.397240 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f951ae72-e65a-4411-b9b1-0966dc26dfb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:41.397772 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f951ae72-e65a-4411-b9b1-0966dc26dfb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:41.398556 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f951ae72-e65a-4411-b9b1-0966dc26dfb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:41.398988 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f951ae72-e65a-4411-b9b1-0966dc26dfb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:41.401829 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=75 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:41.419237 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-f951ae72-e65a-4411-b9b1-0966dc26dfb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] HTTP exception thrown: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f951ae72-e65a-4411-b9b1-0966dc26dfb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Request method failure captured: Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 HTTP/1.1 Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2bfTXNo5hz210hfDVTooV9B1XlfPcDbJKJPiY4aZgYrbHAzM2zrs84fJ6e071Btm_k4-ojg7XeO63ExW_kdVhPPh1Cl2HGlD6dBExPO_vKXg7U-KHzqQQpc09nDEA5A77D9smA85likTwu19sn114gA3WCam9FU0n7MCDf73zEyqt8 Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: 0c63f648631a4a11910b4b135f22b235 Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:30:41.420964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:30:41.423753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c63f648631a4a11910b4b135f22b235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c63f648631a4a11910b4b135f22b235"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0c63f648631a4a11910b4b135f22b235", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0c63f648631a4a11910b4b135f22b235"}]}] Jun 16 17:30:41.423753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:30:41.423753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: 0c63f648631a4a11910b4b135f22b235 Jun 16 17:30:41.423753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:30:41.423753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-AttachVolumeShelveTestJSON-1123487845-project Jun 16 17:30:41.423753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:30:41.423753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:30:41.423753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: 68da2fd51cc84b2b8d641e1e6ac17c72 Jun 16 17:30:41.423753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1123487845-project Jun 16 17:30:41.423753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:30:41.423753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. Jun 16 17:30:41.423753 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': 'a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4'} Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:30:41.425262 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. Jun 16 17:30:41.427931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:30:41.433677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f951ae72-e65a-4411-b9b1-0966dc26dfb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Returning 404 to user: Instance a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:30:41.433677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f951ae72-e65a-4411-b9b1-0966dc26dfb8 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4" status: 404 len: 111 microversion: 2.20 time: 0.039259 Jun 16 17:30:41.433677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 428/855] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:30:41 2022] GET /compute/v2.1/servers/a9f207ac-0a5d-4cfc-abd6-2f2fc88ab6a4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:30:42.589009 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-23a8174b-c25e-41a7-a930-de281760b896 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:42.589805 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-23a8174b-c25e-41a7-a930-de281760b896 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:42.597868 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-23a8174b-c25e-41a7-a930-de281760b896 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:42.598307 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-23a8174b-c25e-41a7-a930-de281760b896 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:42.599076 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-23a8174b-c25e-41a7-a930-de281760b896 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:42.599501 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-23a8174b-c25e-41a7-a930-de281760b896 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:42.615402 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-23a8174b-c25e-41a7-a930-de281760b896 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] HTTP exception thrown: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-23a8174b-c25e-41a7-a930-de281760b896 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Request method failure captured: Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: DELETE /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 HTTP/1.1 Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2bfTXNo5hz210hfDVTooV9B1XlfPcDbJKJPiY4aZgYrbHAzM2zrs84fJ6e071Btm_k4-ojg7XeO63ExW_kdVhPPh1Cl2HGlD6dBExPO_vKXg7U-KHzqQQpc09nDEA5A77D9smA85likTwu19sn114gA3WCam9FU0n7MCDf73zEyqt8 Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 0c63f648631a4a11910b4b135f22b235 Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:30:42.616995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:30:42.618439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c63f648631a4a11910b4b135f22b235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c63f648631a4a11910b4b135f22b235"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0c63f648631a4a11910b4b135f22b235", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0c63f648631a4a11910b4b135f22b235"}]}] Jun 16 17:30:42.618439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:30:42.618439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 0c63f648631a4a11910b4b135f22b235 Jun 16 17:30:42.618439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:30:42.618439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-AttachVolumeShelveTestJSON-1123487845-project Jun 16 17:30:42.618439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:30:42.618439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:30:42.618439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 68da2fd51cc84b2b8d641e1e6ac17c72 Jun 16 17:30:42.618439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1123487845-project Jun 16 17:30:42.618439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:30:42.618439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. Jun 16 17:30:42.618439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': 'ab2e7148-fa86-4648-9e4b-87e27fcf1147'} Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:30:42.619253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. Jun 16 17:30:42.620760 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:30:42.622300 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-23a8174b-c25e-41a7-a930-de281760b896 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Returning 404 to user: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:30:42.622300 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-23a8174b-c25e-41a7-a930-de281760b896 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 404 len: 111 microversion: 2.20 time: 0.033656 Jun 16 17:30:42.622300 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 428/856] 10.222.0.66 () {60 vars in 1279 bytes} [Thu Jun 16 17:30:42 2022] DELETE /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:30:42.627291 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-448972e1-0912-4d21-b901-b5242a920d63 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:42.627849 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-448972e1-0912-4d21-b901-b5242a920d63 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] [instance: ab2e7148-fa86-4648-9e4b-87e27fcf1147] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:42.637152 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-448972e1-0912-4d21-b901-b5242a920d63 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:42.637853 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-448972e1-0912-4d21-b901-b5242a920d63 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:42.638642 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-448972e1-0912-4d21-b901-b5242a920d63 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:42.639077 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-448972e1-0912-4d21-b901-b5242a920d63 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:42.656750 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-448972e1-0912-4d21-b901-b5242a920d63 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] HTTP exception thrown: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-448972e1-0912-4d21-b901-b5242a920d63 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Request method failure captured: Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 HTTP/1.1 Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2bfTXNo5hz210hfDVTooV9B1XlfPcDbJKJPiY4aZgYrbHAzM2zrs84fJ6e071Btm_k4-ojg7XeO63ExW_kdVhPPh1Cl2HGlD6dBExPO_vKXg7U-KHzqQQpc09nDEA5A77D9smA85likTwu19sn114gA3WCam9FU0n7MCDf73zEyqt8 Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: 0c63f648631a4a11910b4b135f22b235 Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:30:42.658546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:30:42.660264 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c63f648631a4a11910b4b135f22b235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c63f648631a4a11910b4b135f22b235"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0c63f648631a4a11910b4b135f22b235", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0c63f648631a4a11910b4b135f22b235"}]}] Jun 16 17:30:42.660264 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:30:42.660264 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: 0c63f648631a4a11910b4b135f22b235 Jun 16 17:30:42.660264 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1123487845 Jun 16 17:30:42.660264 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-AttachVolumeShelveTestJSON-1123487845-project Jun 16 17:30:42.660264 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:30:42.660264 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:30:42.660264 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: 68da2fd51cc84b2b8d641e1e6ac17c72 Jun 16 17:30:42.660264 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1123487845-project Jun 16 17:30:42.660264 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:30:42.660264 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. Jun 16 17:30:42.660264 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': 'ab2e7148-fa86-4648-9e4b-87e27fcf1147'} Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:30:42.661048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. Jun 16 17:30:42.662317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:30:42.663509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-448972e1-0912-4d21-b901-b5242a920d63 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] Returning 404 to user: Instance ab2e7148-fa86-4648-9e4b-87e27fcf1147 could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:30:42.663509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-448972e1-0912-4d21-b901-b5242a920d63 tempest-AttachVolumeShelveTestJSON-1123487845 tempest-AttachVolumeShelveTestJSON-1123487845-project] 10.222.0.66 "GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147" status: 404 len: 111 microversion: 2.20 time: 0.036609 Jun 16 17:30:42.663509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 429/857] 10.222.0.66 () {60 vars in 1276 bytes} [Thu Jun 16 17:30:42 2022] GET /compute/v2.1/servers/ab2e7148-fa86-4648-9e4b-87e27fcf1147 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 17:30:52.593357 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-3ae049b1-ce54-48c2-9ae2-bb78e3139658 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Action: 'create', calling method: .version_select at 0x7f66b14fd280>, body: {"keypair": {"name": "tempest-keypair-1732637549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSjm5zsyPeAvwQ0i1ridG5YDLC4bmvh40MyXX7T3LH8EGLN2f2eZ3k7GdDA7sMAji3/GD4b7rcEHGvlMLS7J2ONTLxkTV/iQtR8Ahchqs0Q8PmfG6SnZZ2fNg6DNR9Xsg=="}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:30:52.597704 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=3 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:52.605328 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=3 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:52.612312 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-3ae049b1-ce54-48c2-9ae2-bb78e3139658 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Getting quotas for project 7c56d4c430c44df49f48fe0b49ebcbd2. Resources: {'key_pairs'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:30:52.617232 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-3ae049b1-ce54-48c2-9ae2-bb78e3139658 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Getting quotas for user 642ef5f213254d818de4888cca274311 and project 7c56d4c430c44df49f48fe0b49ebcbd2. Resources: {'key_pairs'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:30:52.643959 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-3ae049b1-ce54-48c2-9ae2-bb78e3139658 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.214597 Jun 16 17:30:52.644718 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 429/858] 10.222.0.66 () {60 vars in 1158 bytes} [Thu Jun 16 17:30:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:30:54.245766 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-1b95ecf7-68c6-44e9-8a55-64a66f175825 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1111690672", "imageRef": "c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38b62bc9-5cad-4b9e-8181-628535658100"}], "security_groups": [{"name": "tempest-securitygroup--2063534317"}], "key_name": "tempest-keypair-1732637549", "user_data": "}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:30:54.252959 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:54.253624 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=3 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:54.359068 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.network.neutron [None req-1b95ecf7-68c6-44e9-8a55-64a66f175825 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] validate_networks() for [('38b62bc9-5cad-4b9e-8181-628535658100', None, None, None, None, None)] {{(pid=117553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:30:54.791883 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-1b95ecf7-68c6-44e9-8a55-64a66f175825 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Flavor limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:30:54.792483 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-1b95ecf7-68c6-44e9-8a55-64a66f175825 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Image limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:30:54.793169 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-1b95ecf7-68c6-44e9-8a55-64a66f175825 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Flavor pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:30:54.793979 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-1b95ecf7-68c6-44e9-8a55-64a66f175825 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Image pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:30:54.794629 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-1b95ecf7-68c6-44e9-8a55-64a66f175825 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:30:54.806297 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1b95ecf7-68c6-44e9-8a55-64a66f175825 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:54.806747 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1b95ecf7-68c6-44e9-8a55-64a66f175825 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:54.807542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1b95ecf7-68c6-44e9-8a55-64a66f175825 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:54.807973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1b95ecf7-68c6-44e9-8a55-64a66f175825 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:54.827715 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-1b95ecf7-68c6-44e9-8a55-64a66f175825 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Getting quotas for project 7c56d4c430c44df49f48fe0b49ebcbd2. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:30:54.832492 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-1b95ecf7-68c6-44e9-8a55-64a66f175825 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Getting quotas for user 642ef5f213254d818de4888cca274311 and project 7c56d4c430c44df49f48fe0b49ebcbd2. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:30:54.848186 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-1b95ecf7-68c6-44e9-8a55-64a66f175825 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Going to run 1 instances... {{(pid=117553) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:30:54.850529 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-1b95ecf7-68c6-44e9-8a55-64a66f175825 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:30:54.913629 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-1b95ecf7-68c6-44e9-8a55-64a66f175825 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.672193 Jun 16 17:30:54.915021 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 430/859] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:30:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:30:54.927009 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f1b9e572-d5c9-43de-8540-28d108f55636 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:54.928180 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f1b9e572-d5c9-43de-8540-28d108f55636 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:55.018903 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f1b9e572-d5c9-43de-8540-28d108f55636 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:55.026547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f1b9e572-d5c9-43de-8540-28d108f55636 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c" status: 200 len: 1242 microversion: 2.1 time: 0.105428 Jun 16 17:30:55.027800 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 430/860] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:54 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:56.053732 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-73a18c70-ccd9-446e-b7a7-0387745d88e2 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:56.054459 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-73a18c70-ccd9-446e-b7a7-0387745d88e2 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:56.069797 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-73a18c70-ccd9-446e-b7a7-0387745d88e2 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:56.073516 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-73a18c70-ccd9-446e-b7a7-0387745d88e2 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:56.075500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-73a18c70-ccd9-446e-b7a7-0387745d88e2 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:56.076174 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-73a18c70-ccd9-446e-b7a7-0387745d88e2 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:56.215210 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-73a18c70-ccd9-446e-b7a7-0387745d88e2 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:56.228861 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-73a18c70-ccd9-446e-b7a7-0387745d88e2 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c" status: 200 len: 1294 microversion: 2.1 time: 0.185721 Jun 16 17:30:56.230207 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 431/861] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:56 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c => generated 1294 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:57.250321 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-79a2076e-4747-4365-822b-089df59f0992 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:57.251315 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-79a2076e-4747-4365-822b-089df59f0992 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:57.263247 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-79a2076e-4747-4365-822b-089df59f0992 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:57.264359 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-79a2076e-4747-4365-822b-089df59f0992 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:57.265979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-79a2076e-4747-4365-822b-089df59f0992 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:57.266703 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-79a2076e-4747-4365-822b-089df59f0992 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:57.345292 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-79a2076e-4747-4365-822b-089df59f0992 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:57.354896 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-79a2076e-4747-4365-822b-089df59f0992 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c" status: 200 len: 1300 microversion: 2.1 time: 0.108900 Jun 16 17:30:57.355692 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 431/862] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:57 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:58.380267 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-803d0532-48a7-40ae-8c92-ffc0ec8646b7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:58.381794 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-803d0532-48a7-40ae-8c92-ffc0ec8646b7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:58.389129 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-803d0532-48a7-40ae-8c92-ffc0ec8646b7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:58.389595 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-803d0532-48a7-40ae-8c92-ffc0ec8646b7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:58.390588 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-803d0532-48a7-40ae-8c92-ffc0ec8646b7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:58.391972 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-803d0532-48a7-40ae-8c92-ffc0ec8646b7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:58.547848 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-803d0532-48a7-40ae-8c92-ffc0ec8646b7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:58.555972 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-803d0532-48a7-40ae-8c92-ffc0ec8646b7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c" status: 200 len: 1368 microversion: 2.1 time: 0.184968 Jun 16 17:30:58.556539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 432/863] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:58 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:30:58.641382 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-7201711d-b120-4924-ad5b-c30aded59252 req-c3ec1596-6200-47bd-8bd4-dd85417f3fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dce5739-2ecb-43f7-a49a-a9870cf2243c", "tag": "f5cc2aae-859d-43dd-a5a3-7df6d8cbc7fa"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:30:58.653990 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-7201711d-b120-4924-ad5b-c30aded59252 req-c3ec1596-6200-47bd-8bd4-dd85417f3fe9 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:58.653990 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-7201711d-b120-4924-ad5b-c30aded59252 req-c3ec1596-6200-47bd-8bd4-dd85417f3fe9 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:58.675983 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-7201711d-b120-4924-ad5b-c30aded59252 req-c3ec1596-6200-47bd-8bd4-dd85417f3fe9 service nova] Creating event network-changed:f5cc2aae-859d-43dd-a5a3-7df6d8cbc7fa for instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c on hv-cinder-83735 Jun 16 17:30:58.682220 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-7201711d-b120-4924-ad5b-c30aded59252 req-c3ec1596-6200-47bd-8bd4-dd85417f3fe9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044632 Jun 16 17:30:58.683411 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 432/864] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:30:59.575411 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4e81bfc9-d770-465d-9669-dda2bce46215 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:30:59.576508 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4e81bfc9-d770-465d-9669-dda2bce46215 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:30:59.589134 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4e81bfc9-d770-465d-9669-dda2bce46215 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:59.589889 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4e81bfc9-d770-465d-9669-dda2bce46215 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:59.591167 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4e81bfc9-d770-465d-9669-dda2bce46215 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:30:59.591840 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4e81bfc9-d770-465d-9669-dda2bce46215 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:30:59.767611 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4e81bfc9-d770-465d-9669-dda2bce46215 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:30:59.775400 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4e81bfc9-d770-465d-9669-dda2bce46215 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c" status: 200 len: 1368 microversion: 2.1 time: 0.206749 Jun 16 17:30:59.775985 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 433/865] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:30:59 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:00.799157 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-35bfaf40-efaf-4180-a024-7adc54632334 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:00.799914 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-35bfaf40-efaf-4180-a024-7adc54632334 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:00.807049 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-35bfaf40-efaf-4180-a024-7adc54632334 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:00.807441 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-35bfaf40-efaf-4180-a024-7adc54632334 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:00.808778 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-35bfaf40-efaf-4180-a024-7adc54632334 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:00.809566 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-35bfaf40-efaf-4180-a024-7adc54632334 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:00.959810 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-35bfaf40-efaf-4180-a024-7adc54632334 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:00.967655 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-35bfaf40-efaf-4180-a024-7adc54632334 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c" status: 200 len: 1368 microversion: 2.1 time: 0.177723 Jun 16 17:31:00.968231 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 433/866] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:00 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:01.985134 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d5dce7ad-55dd-4e73-906e-7b36e1b812e1 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:01.986140 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-d5dce7ad-55dd-4e73-906e-7b36e1b812e1 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:01.994250 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d5dce7ad-55dd-4e73-906e-7b36e1b812e1 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:01.994690 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d5dce7ad-55dd-4e73-906e-7b36e1b812e1 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:01.995456 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d5dce7ad-55dd-4e73-906e-7b36e1b812e1 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:01.995884 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d5dce7ad-55dd-4e73-906e-7b36e1b812e1 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:02.139148 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d5dce7ad-55dd-4e73-906e-7b36e1b812e1 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:02.147769 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-d5dce7ad-55dd-4e73-906e-7b36e1b812e1 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c" status: 200 len: 1368 microversion: 2.1 time: 0.167550 Jun 16 17:31:02.148404 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 434/867] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:01 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:03.164824 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-6aba3770-29bc-4ce7-b60a-d3d482e65717 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:03.165449 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-6aba3770-29bc-4ce7-b60a-d3d482e65717 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:03.172639 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6aba3770-29bc-4ce7-b60a-d3d482e65717 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:03.173087 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6aba3770-29bc-4ce7-b60a-d3d482e65717 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:03.174067 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6aba3770-29bc-4ce7-b60a-d3d482e65717 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:03.174501 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6aba3770-29bc-4ce7-b60a-d3d482e65717 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:03.316144 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-6aba3770-29bc-4ce7-b60a-d3d482e65717 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:03.324067 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-6aba3770-29bc-4ce7-b60a-d3d482e65717 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c" status: 200 len: 1368 microversion: 2.1 time: 0.163819 Jun 16 17:31:03.324646 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 434/868] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:03 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:03.895688 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-e1388f74-27e7-48b6-9e45-46ec34a66c49 req-d78bc56f-8950-42d1-a8cc-e4ad706dcc91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dce5739-2ecb-43f7-a49a-a9870cf2243c", "name": "network-vif-plugged", "status": "completed", "tag": "f5cc2aae-859d-43dd-a5a3-7df6d8cbc7fa"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:31:03.908699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-e1388f74-27e7-48b6-9e45-46ec34a66c49 req-d78bc56f-8950-42d1-a8cc-e4ad706dcc91 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:03.908699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-e1388f74-27e7-48b6-9e45-46ec34a66c49 req-d78bc56f-8950-42d1-a8cc-e4ad706dcc91 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:03.923987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-e1388f74-27e7-48b6-9e45-46ec34a66c49 req-d78bc56f-8950-42d1-a8cc-e4ad706dcc91 service nova] Creating event network-vif-plugged:f5cc2aae-859d-43dd-a5a3-7df6d8cbc7fa for instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c on hv-cinder-83735 Jun 16 17:31:03.931423 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-e1388f74-27e7-48b6-9e45-46ec34a66c49 req-d78bc56f-8950-42d1-a8cc-e4ad706dcc91 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042714 Jun 16 17:31:03.931423 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 435/869] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:31:04.341091 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8b6391b7-f915-420f-a3f3-347aa6123b37 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:04.341814 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8b6391b7-f915-420f-a3f3-347aa6123b37 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:04.348835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8b6391b7-f915-420f-a3f3-347aa6123b37 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:04.349287 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8b6391b7-f915-420f-a3f3-347aa6123b37 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:04.350083 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8b6391b7-f915-420f-a3f3-347aa6123b37 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:04.350521 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8b6391b7-f915-420f-a3f3-347aa6123b37 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:04.491198 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8b6391b7-f915-420f-a3f3-347aa6123b37 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:04.499031 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8b6391b7-f915-420f-a3f3-347aa6123b37 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c" status: 200 len: 1368 microversion: 2.1 time: 0.161975 Jun 16 17:31:04.499612 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 435/870] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:04 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:05.517961 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8b1c3cd7-481d-4c6c-888f-eef773dcaeea tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:05.519122 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-8b1c3cd7-481d-4c6c-888f-eef773dcaeea tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:05.520966 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:05.521750 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=6 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:05.528881 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8b1c3cd7-481d-4c6c-888f-eef773dcaeea tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:05.529305 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8b1c3cd7-481d-4c6c-888f-eef773dcaeea tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:05.530082 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8b1c3cd7-481d-4c6c-888f-eef773dcaeea tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:05.530695 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8b1c3cd7-481d-4c6c-888f-eef773dcaeea tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:05.695121 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8b1c3cd7-481d-4c6c-888f-eef773dcaeea tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:05.703612 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8b1c3cd7-481d-4c6c-888f-eef773dcaeea tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c" status: 200 len: 1558 microversion: 2.1 time: 0.189878 Jun 16 17:31:05.704200 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 436/871] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:05 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c => generated 1558 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:05.721660 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7e00f62d-3733-4ce1-9d1f-627e2508210d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:05.722325 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7e00f62d-3733-4ce1-9d1f-627e2508210d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:05.724390 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=6 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:05.731188 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7e00f62d-3733-4ce1-9d1f-627e2508210d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:05.731635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7e00f62d-3733-4ce1-9d1f-627e2508210d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:05.732448 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7e00f62d-3733-4ce1-9d1f-627e2508210d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:05.732873 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7e00f62d-3733-4ce1-9d1f-627e2508210d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:05.827815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7e00f62d-3733-4ce1-9d1f-627e2508210d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110586 Jun 16 17:31:05.828492 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 436/872] 10.222.0.66 () {58 vars in 1274 bytes} [Thu Jun 16 17:31:05 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:31:06.842366 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-854f5bf2-0a9b-445c-85d2-521682545e85 req-006d98fc-7c7a-4bf2-b05b-e2bd597e811e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dce5739-2ecb-43f7-a49a-a9870cf2243c", "tag": "f5cc2aae-859d-43dd-a5a3-7df6d8cbc7fa"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:31:06.851978 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-854f5bf2-0a9b-445c-85d2-521682545e85 req-006d98fc-7c7a-4bf2-b05b-e2bd597e811e service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:06.852419 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-854f5bf2-0a9b-445c-85d2-521682545e85 req-006d98fc-7c7a-4bf2-b05b-e2bd597e811e service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:06.864919 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-854f5bf2-0a9b-445c-85d2-521682545e85 req-006d98fc-7c7a-4bf2-b05b-e2bd597e811e service nova] Creating event network-changed:f5cc2aae-859d-43dd-a5a3-7df6d8cbc7fa for instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c on hv-cinder-83735 Jun 16 17:31:06.870687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-854f5bf2-0a9b-445c-85d2-521682545e85 req-006d98fc-7c7a-4bf2-b05b-e2bd597e811e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032259 Jun 16 17:31:06.871437 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 437/873] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:31:31.960068 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:31.960929 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=30 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:31.965496 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e01342b3-55e7-438f-9772-60b07381ffce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-814426405", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2110136853", "security_groups": [{"name": "tempest-secgroup-smoke-641343783"}], "block_device_mapping_v2": [{"uuid": "18be64a2-04f2-4d61-b939-1da37d91d67a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3da1c24e-a853-4091-89c9-dc663f379476"}]}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:31:32.085442 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.network.neutron [None req-e01342b3-55e7-438f-9772-60b07381ffce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] validate_networks() for [('3da1c24e-a853-4091-89c9-dc663f379476', None, None, None, None, None)] {{(pid=117552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:31:32.495018 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-e01342b3-55e7-438f-9772-60b07381ffce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Flavor limits 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:31:32.495433 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-e01342b3-55e7-438f-9772-60b07381ffce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Image limits 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:31:32.495922 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-e01342b3-55e7-438f-9772-60b07381ffce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Flavor pref 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:31:32.496377 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-e01342b3-55e7-438f-9772-60b07381ffce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Image pref 0:0:0 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:31:32.496779 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.virt.hardware [None req-e01342b3-55e7-438f-9772-60b07381ffce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:31:32.507388 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e01342b3-55e7-438f-9772-60b07381ffce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:32.507837 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e01342b3-55e7-438f-9772-60b07381ffce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:32.508641 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e01342b3-55e7-438f-9772-60b07381ffce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:32.509075 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e01342b3-55e7-438f-9772-60b07381ffce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:32.527935 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-e01342b3-55e7-438f-9772-60b07381ffce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Getting quotas for project bd1488226a424c6e9e7f94f31b020e4f. Resources: {'cores', 'instances', 'ram'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:31:32.532390 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-e01342b3-55e7-438f-9772-60b07381ffce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Getting quotas for user fbbafeb56a4d4fd282275e4198ede783 and project bd1488226a424c6e9e7f94f31b020e4f. Resources: {'cores', 'instances', 'ram'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:31:32.597991 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e01342b3-55e7-438f-9772-60b07381ffce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Going to run 1 instances... {{(pid=117552) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:31:32.600025 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e01342b3-55e7-438f-9772-60b07381ffce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='18be64a2-04f2-4d61-b939-1da37d91d67a',volume_size=None,volume_type=None)] {{(pid=117552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:31:32.737068 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-e01342b3-55e7-438f-9772-60b07381ffce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.778407 Jun 16 17:31:32.738310 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 437/874] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:31:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 17:31:32.750118 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-71930926-b7b6-4f41-90ca-8aa8a7a51855 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:32.751001 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-71930926-b7b6-4f41-90ca-8aa8a7a51855 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:32.754445 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:32.755755 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=36 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:32.814931 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-71930926-b7b6-4f41-90ca-8aa8a7a51855 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:32.822146 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-71930926-b7b6-4f41-90ca-8aa8a7a51855 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1094 microversion: 2.1 time: 0.076281 Jun 16 17:31:32.822838 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 438/875] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:32 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:33.840476 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f8082e18-b124-4e75-84a5-30ecdd09f220 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:33.841070 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f8082e18-b124-4e75-84a5-30ecdd09f220 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:33.848002 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f8082e18-b124-4e75-84a5-30ecdd09f220 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:33.848726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f8082e18-b124-4e75-84a5-30ecdd09f220 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:33.850067 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f8082e18-b124-4e75-84a5-30ecdd09f220 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:33.850853 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f8082e18-b124-4e75-84a5-30ecdd09f220 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:33.935493 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f8082e18-b124-4e75-84a5-30ecdd09f220 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:33.948928 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f8082e18-b124-4e75-84a5-30ecdd09f220 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1210 microversion: 2.1 time: 0.112797 Jun 16 17:31:33.949736 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 438/876] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:33 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1210 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:34.972048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-244d9579-6225-4695-8a61-2b2206ba39ae tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:34.973336 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-244d9579-6225-4695-8a61-2b2206ba39ae tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:34.981539 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-244d9579-6225-4695-8a61-2b2206ba39ae tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:34.981902 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-244d9579-6225-4695-8a61-2b2206ba39ae tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:34.982671 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-244d9579-6225-4695-8a61-2b2206ba39ae tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:34.983100 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-244d9579-6225-4695-8a61-2b2206ba39ae tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:35.146595 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-244d9579-6225-4695-8a61-2b2206ba39ae tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:35.156257 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-244d9579-6225-4695-8a61-2b2206ba39ae tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1265 microversion: 2.1 time: 0.188710 Jun 16 17:31:35.157195 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 439/877] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:34 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:35.300741 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-67bb9c69-2bfa-4f64-98a2-7aae238fed6a req-9d948dd3-6009-4634-9e21-5641ac4541f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846547de-f4c6-43da-80ab-05da7d9fccf3", "tag": "36fcbcc2-2d79-4ffe-9727-2ad369c03b4a"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:31:35.322535 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-67bb9c69-2bfa-4f64-98a2-7aae238fed6a req-9d948dd3-6009-4634-9e21-5641ac4541f4 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:35.322977 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-67bb9c69-2bfa-4f64-98a2-7aae238fed6a req-9d948dd3-6009-4634-9e21-5641ac4541f4 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:35.344864 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-67bb9c69-2bfa-4f64-98a2-7aae238fed6a req-9d948dd3-6009-4634-9e21-5641ac4541f4 service nova] Creating event network-changed:36fcbcc2-2d79-4ffe-9727-2ad369c03b4a for instance 846547de-f4c6-43da-80ab-05da7d9fccf3 on hv-cinder-83735 Jun 16 17:31:35.357439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-67bb9c69-2bfa-4f64-98a2-7aae238fed6a req-9d948dd3-6009-4634-9e21-5641ac4541f4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059580 Jun 16 17:31:35.358495 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 439/878] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:31:36.177154 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-3ab75401-c179-4fcb-ba82-be1441db50ae tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:36.179255 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-3ab75401-c179-4fcb-ba82-be1441db50ae tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:36.187785 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3ab75401-c179-4fcb-ba82-be1441db50ae tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:36.189128 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3ab75401-c179-4fcb-ba82-be1441db50ae tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:36.190220 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3ab75401-c179-4fcb-ba82-be1441db50ae tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:36.191412 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3ab75401-c179-4fcb-ba82-be1441db50ae tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:36.388240 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-3ab75401-c179-4fcb-ba82-be1441db50ae tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:36.397016 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-3ab75401-c179-4fcb-ba82-be1441db50ae tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1265 microversion: 2.1 time: 0.225602 Jun 16 17:31:36.397830 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 440/879] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:36 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:37.416533 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-36c4cd64-5d27-4482-b191-0ef44184007d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:37.417163 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-36c4cd64-5d27-4482-b191-0ef44184007d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:37.424442 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-36c4cd64-5d27-4482-b191-0ef44184007d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:37.425130 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-36c4cd64-5d27-4482-b191-0ef44184007d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:37.426105 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-36c4cd64-5d27-4482-b191-0ef44184007d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:37.426581 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-36c4cd64-5d27-4482-b191-0ef44184007d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:37.572613 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-36c4cd64-5d27-4482-b191-0ef44184007d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:37.581085 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-36c4cd64-5d27-4482-b191-0ef44184007d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1265 microversion: 2.1 time: 0.169605 Jun 16 17:31:37.582018 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 440/880] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:37 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:38.599561 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-79b5102e-b63e-4a7b-a3c7-cb0cb93a0966 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:38.600190 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-79b5102e-b63e-4a7b-a3c7-cb0cb93a0966 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:38.607246 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-79b5102e-b63e-4a7b-a3c7-cb0cb93a0966 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:38.607721 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-79b5102e-b63e-4a7b-a3c7-cb0cb93a0966 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:38.608507 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-79b5102e-b63e-4a7b-a3c7-cb0cb93a0966 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:38.608938 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-79b5102e-b63e-4a7b-a3c7-cb0cb93a0966 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:38.756317 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-79b5102e-b63e-4a7b-a3c7-cb0cb93a0966 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:38.765747 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-79b5102e-b63e-4a7b-a3c7-cb0cb93a0966 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1265 microversion: 2.1 time: 0.170953 Jun 16 17:31:38.766328 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 441/881] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:38 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:39.787164 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-63ff5659-c746-4a7a-9139-dadd1e497ef0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:39.787811 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-63ff5659-c746-4a7a-9139-dadd1e497ef0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:39.794588 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-63ff5659-c746-4a7a-9139-dadd1e497ef0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:39.795037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-63ff5659-c746-4a7a-9139-dadd1e497ef0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:39.795789 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-63ff5659-c746-4a7a-9139-dadd1e497ef0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:39.796218 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-63ff5659-c746-4a7a-9139-dadd1e497ef0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:39.940697 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-63ff5659-c746-4a7a-9139-dadd1e497ef0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:39.948852 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-63ff5659-c746-4a7a-9139-dadd1e497ef0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1265 microversion: 2.1 time: 0.166767 Jun 16 17:31:39.949479 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 441/882] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:39 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:40.966224 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-908b2f5a-98c9-41a1-af69-333c08b8f3b6 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:40.966871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-908b2f5a-98c9-41a1-af69-333c08b8f3b6 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:40.975874 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-908b2f5a-98c9-41a1-af69-333c08b8f3b6 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:40.976322 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-908b2f5a-98c9-41a1-af69-333c08b8f3b6 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:40.977129 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-908b2f5a-98c9-41a1-af69-333c08b8f3b6 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:40.977649 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-908b2f5a-98c9-41a1-af69-333c08b8f3b6 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:41.117714 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-908b2f5a-98c9-41a1-af69-333c08b8f3b6 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:41.129821 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-908b2f5a-98c9-41a1-af69-333c08b8f3b6 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1265 microversion: 2.1 time: 0.167049 Jun 16 17:31:41.130775 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 442/883] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:40 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:42.153088 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-553852ca-a496-4241-9424-f805af8c07ce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:42.153759 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-553852ca-a496-4241-9424-f805af8c07ce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:42.160364 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-553852ca-a496-4241-9424-f805af8c07ce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:42.160809 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-553852ca-a496-4241-9424-f805af8c07ce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:42.161619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-553852ca-a496-4241-9424-f805af8c07ce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:42.162045 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-553852ca-a496-4241-9424-f805af8c07ce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:42.305462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-553852ca-a496-4241-9424-f805af8c07ce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:42.314413 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-553852ca-a496-4241-9424-f805af8c07ce tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1265 microversion: 2.1 time: 0.165464 Jun 16 17:31:42.314966 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 442/884] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:42 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:43.008935 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ef30af49-7c78-4a09-a88e-3cf6c83d2fa1 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:43.009500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ef30af49-7c78-4a09-a88e-3cf6c83d2fa1 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:43.012088 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:43.018648 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ef30af49-7c78-4a09-a88e-3cf6c83d2fa1 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:43.019035 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ef30af49-7c78-4a09-a88e-3cf6c83d2fa1 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:43.019976 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ef30af49-7c78-4a09-a88e-3cf6c83d2fa1 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:43.020400 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ef30af49-7c78-4a09-a88e-3cf6c83d2fa1 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:43.048547 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ef30af49-7c78-4a09-a88e-3cf6c83d2fa1 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c/ips" status: 200 len: 148 microversion: 2.1 time: 0.046363 Jun 16 17:31:43.054288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 443/885] 10.222.0.66 () {58 vars in 1247 bytes} [Thu Jun 16 17:31:43 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c/ips => generated 148 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:31:43.335082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5af27bb7-3dc8-43b7-821e-98cdd0e678e0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:43.335876 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-5af27bb7-3dc8-43b7-821e-98cdd0e678e0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:43.352681 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:43.352681 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=6 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:43.352681 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5af27bb7-3dc8-43b7-821e-98cdd0e678e0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:43.352681 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5af27bb7-3dc8-43b7-821e-98cdd0e678e0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:43.352681 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5af27bb7-3dc8-43b7-821e-98cdd0e678e0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:43.353701 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5af27bb7-3dc8-43b7-821e-98cdd0e678e0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:43.526746 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5af27bb7-3dc8-43b7-821e-98cdd0e678e0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:43.540740 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-5af27bb7-3dc8-43b7-821e-98cdd0e678e0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1265 microversion: 2.1 time: 0.211761 Jun 16 17:31:43.541444 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 443/886] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:43 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:44.481813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-22d7bc4f-2e8d-47b4-b8d2-7b84fc9a8e77 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7822259a-4f9d-44f5-9493-278879f1e351"}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:31:44.482879 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-22d7bc4f-2e8d-47b4-b8d2-7b84fc9a8e77 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:44.490598 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-22d7bc4f-2e8d-47b4-b8d2-7b84fc9a8e77 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:44.490598 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-22d7bc4f-2e8d-47b4-b8d2-7b84fc9a8e77 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:44.491375 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-22d7bc4f-2e8d-47b4-b8d2-7b84fc9a8e77 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:44.491809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-22d7bc4f-2e8d-47b4-b8d2-7b84fc9a8e77 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:44.560928 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c39b59c1-29f9-4bc6-96c3-c9233211bef4 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:44.561696 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c39b59c1-29f9-4bc6-96c3-c9233211bef4 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:44.569352 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c39b59c1-29f9-4bc6-96c3-c9233211bef4 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:44.569904 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c39b59c1-29f9-4bc6-96c3-c9233211bef4 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:44.570956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c39b59c1-29f9-4bc6-96c3-c9233211bef4 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:44.571745 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c39b59c1-29f9-4bc6-96c3-c9233211bef4 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:44.745411 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c39b59c1-29f9-4bc6-96c3-c9233211bef4 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:44.754250 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c39b59c1-29f9-4bc6-96c3-c9233211bef4 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1265 microversion: 2.1 time: 0.197928 Jun 16 17:31:44.754843 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 444/887] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:44 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:31:44.801544 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-22d7bc4f-2e8d-47b4-b8d2-7b84fc9a8e77 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "POST /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323426 Jun 16 17:31:44.802505 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 444/888] 10.222.0.66 () {60 vars in 1322 bytes} [Thu Jun 16 17:31:44 2022] POST /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:31:45.775158 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8ea7c414-c6c4-44eb-8c15-3d769b588c57 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:45.775791 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8ea7c414-c6c4-44eb-8c15-3d769b588c57 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:45.784721 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ea7c414-c6c4-44eb-8c15-3d769b588c57 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:45.785208 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ea7c414-c6c4-44eb-8c15-3d769b588c57 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:45.785976 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ea7c414-c6c4-44eb-8c15-3d769b588c57 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:45.786402 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ea7c414-c6c4-44eb-8c15-3d769b588c57 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:45.948393 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8ea7c414-c6c4-44eb-8c15-3d769b588c57 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:45.956873 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8ea7c414-c6c4-44eb-8c15-3d769b588c57 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1265 microversion: 2.1 time: 0.187928 Jun 16 17:31:45.957748 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 445/889] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:45 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:46.107091 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-62473e3a-b00e-4be2-98b5-24143d5ed642 req-25a42d4d-c815-4b63-b3c7-34efe80038ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846547de-f4c6-43da-80ab-05da7d9fccf3", "name": "network-vif-plugged", "status": "completed", "tag": "36fcbcc2-2d79-4ffe-9727-2ad369c03b4a"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:31:46.117927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-62473e3a-b00e-4be2-98b5-24143d5ed642 req-25a42d4d-c815-4b63-b3c7-34efe80038ee service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:46.118707 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-62473e3a-b00e-4be2-98b5-24143d5ed642 req-25a42d4d-c815-4b63-b3c7-34efe80038ee service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:46.136268 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-62473e3a-b00e-4be2-98b5-24143d5ed642 req-25a42d4d-c815-4b63-b3c7-34efe80038ee service nova] Creating event network-vif-plugged:36fcbcc2-2d79-4ffe-9727-2ad369c03b4a for instance 846547de-f4c6-43da-80ab-05da7d9fccf3 on hv-cinder-83735 Jun 16 17:31:46.141940 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-62473e3a-b00e-4be2-98b5-24143d5ed642 req-25a42d4d-c815-4b63-b3c7-34efe80038ee service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039091 Jun 16 17:31:46.142602 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 445/890] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:31:46.974463 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d3ada87b-7c9d-48ac-9247-8e1a1b8485b3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:46.975096 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d3ada87b-7c9d-48ac-9247-8e1a1b8485b3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:46.983281 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d3ada87b-7c9d-48ac-9247-8e1a1b8485b3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:46.983281 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d3ada87b-7c9d-48ac-9247-8e1a1b8485b3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:46.983507 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d3ada87b-7c9d-48ac-9247-8e1a1b8485b3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:46.983964 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d3ada87b-7c9d-48ac-9247-8e1a1b8485b3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:47.129399 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d3ada87b-7c9d-48ac-9247-8e1a1b8485b3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:47.141691 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d3ada87b-7c9d-48ac-9247-8e1a1b8485b3 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1265 microversion: 2.1 time: 0.170856 Jun 16 17:31:47.142537 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 446/891] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:46 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:48.165343 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-05127774-65f2-4ea2-9a86-5e13e89c6e13 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:48.166033 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-05127774-65f2-4ea2-9a86-5e13e89c6e13 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:48.172686 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-05127774-65f2-4ea2-9a86-5e13e89c6e13 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:48.173124 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-05127774-65f2-4ea2-9a86-5e13e89c6e13 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:48.173928 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-05127774-65f2-4ea2-9a86-5e13e89c6e13 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:48.174347 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-05127774-65f2-4ea2-9a86-5e13e89c6e13 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:48.324392 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-05127774-65f2-4ea2-9a86-5e13e89c6e13 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:48.333819 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-05127774-65f2-4ea2-9a86-5e13e89c6e13 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1453 microversion: 2.1 time: 0.174028 Jun 16 17:31:48.334386 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 446/892] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:48 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:31:48.351726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-2b8e1188-e65c-4cf7-b709-a01d8e29e0b0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:48.352335 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-2b8e1188-e65c-4cf7-b709-a01d8e29e0b0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:48.360320 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2b8e1188-e65c-4cf7-b709-a01d8e29e0b0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:48.360768 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2b8e1188-e65c-4cf7-b709-a01d8e29e0b0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:48.361571 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2b8e1188-e65c-4cf7-b709-a01d8e29e0b0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:48.362002 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2b8e1188-e65c-4cf7-b709-a01d8e29e0b0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:48.537245 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2b8e1188-e65c-4cf7-b709-a01d8e29e0b0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:48.545436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-2b8e1188-e65c-4cf7-b709-a01d8e29e0b0 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1453 microversion: 2.1 time: 0.197579 Jun 16 17:31:48.546049 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 447/893] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:48 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1453 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:50.688675 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-447b8d4d-5fe8-4d13-b555-c90a5690d82a req-2c70974a-41d4-4cbc-8470-0ffc17c015d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846547de-f4c6-43da-80ab-05da7d9fccf3", "tag": "36fcbcc2-2d79-4ffe-9727-2ad369c03b4a"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:31:50.698052 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-447b8d4d-5fe8-4d13-b555-c90a5690d82a req-2c70974a-41d4-4cbc-8470-0ffc17c015d2 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:50.698501 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-447b8d4d-5fe8-4d13-b555-c90a5690d82a req-2c70974a-41d4-4cbc-8470-0ffc17c015d2 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:50.711179 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-447b8d4d-5fe8-4d13-b555-c90a5690d82a req-2c70974a-41d4-4cbc-8470-0ffc17c015d2 service nova] Creating event network-changed:36fcbcc2-2d79-4ffe-9727-2ad369c03b4a for instance 846547de-f4c6-43da-80ab-05da7d9fccf3 on hv-cinder-83735 Jun 16 17:31:50.716408 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-447b8d4d-5fe8-4d13-b555-c90a5690d82a req-2c70974a-41d4-4cbc-8470-0ffc17c015d2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031413 Jun 16 17:31:50.717009 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 447/894] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:31:52.337399 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9999fae1-5e76-49e8-a379-3d2cbd247ee4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Action: 'create', calling method: .version_select at 0x7f66b1663160>, body: {"keypair": {"name": "tempest-keypair-452367967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOWoksL+il8JO3CMQBaOln2WKAsfVnjrYe//VddTYXnrHrpcq7orcrSpytLwaaGQqjP+Wo+Ldz0KlYRYe+YjRdDuyoxHPMsznBEB+izb+sPO4hn49BMjRQ6PUREkKprgQ=="}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:31:52.353801 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-9999fae1-5e76-49e8-a379-3d2cbd247ee4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Getting quotas for project 7c56d4c430c44df49f48fe0b49ebcbd2. Resources: {'key_pairs'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:31:52.358133 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-9999fae1-5e76-49e8-a379-3d2cbd247ee4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Getting quotas for user 642ef5f213254d818de4888cca274311 and project 7c56d4c430c44df49f48fe0b49ebcbd2. Resources: {'key_pairs'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:31:52.381861 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9999fae1-5e76-49e8-a379-3d2cbd247ee4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048311 Jun 16 17:31:52.382455 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 448/895] 10.222.0.66 () {60 vars in 1158 bytes} [Thu Jun 16 17:31:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:31:53.745790 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-70a010a2-2f23-4648-b1af-3b206831e3f4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1176950401", "imageRef": "c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38b62bc9-5cad-4b9e-8181-628535658100"}], "security_groups": [{"name": "tempest-securitygroup--89292257"}], "key_name": "tempest-keypair-452367967", "user_data": "}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:31:53.857715 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.network.neutron [None req-70a010a2-2f23-4648-b1af-3b206831e3f4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] validate_networks() for [('38b62bc9-5cad-4b9e-8181-628535658100', None, None, None, None, None)] {{(pid=117553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:31:54.262056 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-70a010a2-2f23-4648-b1af-3b206831e3f4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Flavor limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:31:54.262496 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-70a010a2-2f23-4648-b1af-3b206831e3f4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Image limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:31:54.262961 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-70a010a2-2f23-4648-b1af-3b206831e3f4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Flavor pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:31:54.263329 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-70a010a2-2f23-4648-b1af-3b206831e3f4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Image pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:31:54.263728 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-70a010a2-2f23-4648-b1af-3b206831e3f4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:31:54.273119 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-70a010a2-2f23-4648-b1af-3b206831e3f4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:54.273587 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-70a010a2-2f23-4648-b1af-3b206831e3f4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:54.274369 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-70a010a2-2f23-4648-b1af-3b206831e3f4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:54.274794 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-70a010a2-2f23-4648-b1af-3b206831e3f4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:54.297922 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-70a010a2-2f23-4648-b1af-3b206831e3f4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Getting quotas for project 7c56d4c430c44df49f48fe0b49ebcbd2. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:31:54.302481 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-70a010a2-2f23-4648-b1af-3b206831e3f4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Getting quotas for user 642ef5f213254d818de4888cca274311 and project 7c56d4c430c44df49f48fe0b49ebcbd2. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:31:54.314234 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-70a010a2-2f23-4648-b1af-3b206831e3f4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Going to run 1 instances... {{(pid=117553) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:31:54.316651 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-70a010a2-2f23-4648-b1af-3b206831e3f4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:31:54.366456 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-70a010a2-2f23-4648-b1af-3b206831e3f4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.625281 Jun 16 17:31:54.367112 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 448/896] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:31:53 2022] POST /compute/v2.1/servers => generated 400 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:31:54.377941 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8391a531-c3ba-4f2e-8704-4103430d6f2a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:54.379215 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8391a531-c3ba-4f2e-8704-4103430d6f2a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:54.438005 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8391a531-c3ba-4f2e-8704-4103430d6f2a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:54.446428 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8391a531-c3ba-4f2e-8704-4103430d6f2a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 200 len: 1241 microversion: 2.1 time: 0.072354 Jun 16 17:31:54.447265 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 449/897] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:54 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:31:55.464642 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8e5acf57-a281-4139-905f-8d8ac1ba69b8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:55.466219 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-8e5acf57-a281-4139-905f-8d8ac1ba69b8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:55.477645 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8e5acf57-a281-4139-905f-8d8ac1ba69b8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:55.478599 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8e5acf57-a281-4139-905f-8d8ac1ba69b8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:55.480217 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8e5acf57-a281-4139-905f-8d8ac1ba69b8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:55.480758 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8e5acf57-a281-4139-905f-8d8ac1ba69b8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:55.547506 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8e5acf57-a281-4139-905f-8d8ac1ba69b8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:55.555386 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8e5acf57-a281-4139-905f-8d8ac1ba69b8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 200 len: 1299 microversion: 2.1 time: 0.095137 Jun 16 17:31:55.555944 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 449/898] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:55 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:56.572525 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ab4d2938-f8f4-461d-ad49-1fa706d6a39e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:56.573078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ab4d2938-f8f4-461d-ad49-1fa706d6a39e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:56.580290 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ab4d2938-f8f4-461d-ad49-1fa706d6a39e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:56.580799 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ab4d2938-f8f4-461d-ad49-1fa706d6a39e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:56.582354 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ab4d2938-f8f4-461d-ad49-1fa706d6a39e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:56.582797 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ab4d2938-f8f4-461d-ad49-1fa706d6a39e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:56.824855 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ab4d2938-f8f4-461d-ad49-1fa706d6a39e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:56.832720 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ab4d2938-f8f4-461d-ad49-1fa706d6a39e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 200 len: 1365 microversion: 2.1 time: 0.264505 Jun 16 17:31:56.833291 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 450/899] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:56 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:56.966703 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-1d276a52-e325-48a8-973b-c03d70ae0f72 req-e00a5b4b-d03a-4ef1-885e-e79c72b9af9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ea27cc-1e25-4130-bf8a-60fbfb4801bc", "tag": "fa515d28-8f3c-4376-9029-a6d947163ef0"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:31:56.977583 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-1d276a52-e325-48a8-973b-c03d70ae0f72 req-e00a5b4b-d03a-4ef1-885e-e79c72b9af9d service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:56.986451 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-1d276a52-e325-48a8-973b-c03d70ae0f72 req-e00a5b4b-d03a-4ef1-885e-e79c72b9af9d service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:57.003402 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-1d276a52-e325-48a8-973b-c03d70ae0f72 req-e00a5b4b-d03a-4ef1-885e-e79c72b9af9d service nova] Creating event network-changed:fa515d28-8f3c-4376-9029-a6d947163ef0 for instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc on hv-cinder-83735 Jun 16 17:31:57.008780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-1d276a52-e325-48a8-973b-c03d70ae0f72 req-e00a5b4b-d03a-4ef1-885e-e79c72b9af9d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047502 Jun 16 17:31:57.009747 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 450/900] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:31:57.849801 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f4a2801d-6dd1-425f-bac6-2407850e8e72 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:57.850696 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f4a2801d-6dd1-425f-bac6-2407850e8e72 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:57.858067 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f4a2801d-6dd1-425f-bac6-2407850e8e72 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:57.858585 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f4a2801d-6dd1-425f-bac6-2407850e8e72 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:57.859339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f4a2801d-6dd1-425f-bac6-2407850e8e72 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:57.859857 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f4a2801d-6dd1-425f-bac6-2407850e8e72 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:58.016879 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f4a2801d-6dd1-425f-bac6-2407850e8e72 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:58.025537 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f4a2801d-6dd1-425f-bac6-2407850e8e72 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 200 len: 1365 microversion: 2.1 time: 0.179480 Jun 16 17:31:58.026122 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 451/901] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:57 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:31:59.043402 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-fc812f7c-3972-438a-b52b-147c7f4ad35d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:31:59.044277 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-fc812f7c-3972-438a-b52b-147c7f4ad35d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:31:59.051304 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fc812f7c-3972-438a-b52b-147c7f4ad35d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:59.051736 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fc812f7c-3972-438a-b52b-147c7f4ad35d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:59.052484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fc812f7c-3972-438a-b52b-147c7f4ad35d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:31:59.052906 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fc812f7c-3972-438a-b52b-147c7f4ad35d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:31:59.198977 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-fc812f7c-3972-438a-b52b-147c7f4ad35d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:31:59.212748 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-fc812f7c-3972-438a-b52b-147c7f4ad35d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 200 len: 1365 microversion: 2.1 time: 0.173908 Jun 16 17:31:59.213847 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 451/902] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:31:59 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:00.230100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-36db29bc-d0f9-4c85-b9e6-da4cc3e630e6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:00.230842 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-36db29bc-d0f9-4c85-b9e6-da4cc3e630e6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:00.238297 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-36db29bc-d0f9-4c85-b9e6-da4cc3e630e6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:00.238744 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-36db29bc-d0f9-4c85-b9e6-da4cc3e630e6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:00.239519 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-36db29bc-d0f9-4c85-b9e6-da4cc3e630e6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:00.239942 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-36db29bc-d0f9-4c85-b9e6-da4cc3e630e6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:00.388813 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-36db29bc-d0f9-4c85-b9e6-da4cc3e630e6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:00.397524 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-36db29bc-d0f9-4c85-b9e6-da4cc3e630e6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 200 len: 1365 microversion: 2.1 time: 0.171111 Jun 16 17:32:00.398107 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 452/903] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:00 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:01.414971 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-6dcb17ec-016b-4009-a93d-566dc8a79dcf tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:01.415605 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-6dcb17ec-016b-4009-a93d-566dc8a79dcf tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:01.422991 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6dcb17ec-016b-4009-a93d-566dc8a79dcf tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:01.423420 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6dcb17ec-016b-4009-a93d-566dc8a79dcf tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:01.424183 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6dcb17ec-016b-4009-a93d-566dc8a79dcf tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:01.424631 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6dcb17ec-016b-4009-a93d-566dc8a79dcf tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:01.574533 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6dcb17ec-016b-4009-a93d-566dc8a79dcf tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:01.583246 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-6dcb17ec-016b-4009-a93d-566dc8a79dcf tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 200 len: 1365 microversion: 2.1 time: 0.172164 Jun 16 17:32:01.583939 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 452/904] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:01 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:02.153709 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-4c7c03f7-a391-456c-ba3f-f4e7f17625eb req-aefc3ca4-f4a3-4a98-807d-dcffd386f1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ea27cc-1e25-4130-bf8a-60fbfb4801bc", "name": "network-vif-plugged", "status": "completed", "tag": "fa515d28-8f3c-4376-9029-a6d947163ef0"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:32:02.158678 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:02.168021 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-4c7c03f7-a391-456c-ba3f-f4e7f17625eb req-aefc3ca4-f4a3-4a98-807d-dcffd386f1c9 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:02.168618 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-4c7c03f7-a391-456c-ba3f-f4e7f17625eb req-aefc3ca4-f4a3-4a98-807d-dcffd386f1c9 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:02.175138 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=77 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:02.345581 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-4c7c03f7-a391-456c-ba3f-f4e7f17625eb req-aefc3ca4-f4a3-4a98-807d-dcffd386f1c9 service nova] Creating event network-vif-plugged:fa515d28-8f3c-4376-9029-a6d947163ef0 for instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc on hv-cinder-83735 Jun 16 17:32:02.350899 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-4c7c03f7-a391-456c-ba3f-f4e7f17625eb req-aefc3ca4-f4a3-4a98-807d-dcffd386f1c9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201611 Jun 16 17:32:02.351479 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 453/905] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:32:02.606135 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2e52d4c5-ff52-439e-a4cc-7126c2778d01 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:02.606664 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2e52d4c5-ff52-439e-a4cc-7126c2778d01 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:02.614085 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2e52d4c5-ff52-439e-a4cc-7126c2778d01 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:02.614876 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2e52d4c5-ff52-439e-a4cc-7126c2778d01 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:02.615670 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2e52d4c5-ff52-439e-a4cc-7126c2778d01 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:02.616102 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2e52d4c5-ff52-439e-a4cc-7126c2778d01 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:02.762633 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2e52d4c5-ff52-439e-a4cc-7126c2778d01 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:02.766142 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:02.774514 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2e52d4c5-ff52-439e-a4cc-7126c2778d01 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 200 len: 1365 microversion: 2.1 time: 0.172051 Jun 16 17:32:02.775749 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 453/906] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:02 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:03.796770 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8f6054bf-9333-4471-91de-6f715e431d88 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:03.797361 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8f6054bf-9333-4471-91de-6f715e431d88 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:03.804737 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8f6054bf-9333-4471-91de-6f715e431d88 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:03.805196 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8f6054bf-9333-4471-91de-6f715e431d88 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:03.805970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8f6054bf-9333-4471-91de-6f715e431d88 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:03.806395 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8f6054bf-9333-4471-91de-6f715e431d88 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:03.949362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8f6054bf-9333-4471-91de-6f715e431d88 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:03.957392 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8f6054bf-9333-4471-91de-6f715e431d88 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 200 len: 1365 microversion: 2.1 time: 0.165918 Jun 16 17:32:03.957954 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 454/907] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:03 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:04.975538 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2aef11c5-4b30-452d-8b46-cd68d0492d8a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:04.976470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2aef11c5-4b30-452d-8b46-cd68d0492d8a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:04.980246 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:04.981333 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=6 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:04.982551 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:04.989990 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2aef11c5-4b30-452d-8b46-cd68d0492d8a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:04.990450 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2aef11c5-4b30-452d-8b46-cd68d0492d8a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:04.991246 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2aef11c5-4b30-452d-8b46-cd68d0492d8a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:04.991664 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2aef11c5-4b30-452d-8b46-cd68d0492d8a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:05.130907 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2aef11c5-4b30-452d-8b46-cd68d0492d8a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:05.138842 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2aef11c5-4b30-452d-8b46-cd68d0492d8a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 200 len: 1555 microversion: 2.1 time: 0.168338 Jun 16 17:32:05.139422 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 454/908] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:04 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:32:05.155193 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f1ffb408-76b9-4b6f-95e9-f1ff8c3394fd tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:05.155745 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f1ffb408-76b9-4b6f-95e9-f1ff8c3394fd tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:05.157814 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=6 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:05.163872 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f1ffb408-76b9-4b6f-95e9-f1ff8c3394fd tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:05.164314 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f1ffb408-76b9-4b6f-95e9-f1ff8c3394fd tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:05.165067 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f1ffb408-76b9-4b6f-95e9-f1ff8c3394fd tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:05.165520 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f1ffb408-76b9-4b6f-95e9-f1ff8c3394fd tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:05.249392 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f1ffb408-76b9-4b6f-95e9-f1ff8c3394fd tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098072 Jun 16 17:32:05.250005 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 455/909] 10.222.0.66 () {58 vars in 1274 bytes} [Thu Jun 16 17:32:05 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:32:06.560462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-3577f72b-62a0-42e3-b211-a52a5c94f77f req-b5a01589-04ea-48a4-b211-ae6453230803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ea27cc-1e25-4130-bf8a-60fbfb4801bc", "tag": "fa515d28-8f3c-4376-9029-a6d947163ef0"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:32:06.570342 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-3577f72b-62a0-42e3-b211-a52a5c94f77f req-b5a01589-04ea-48a4-b211-ae6453230803 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:06.570788 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-3577f72b-62a0-42e3-b211-a52a5c94f77f req-b5a01589-04ea-48a4-b211-ae6453230803 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:06.584106 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-3577f72b-62a0-42e3-b211-a52a5c94f77f req-b5a01589-04ea-48a4-b211-ae6453230803 service nova] Creating event network-changed:fa515d28-8f3c-4376-9029-a6d947163ef0 for instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc on hv-cinder-83735 Jun 16 17:32:06.589708 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-3577f72b-62a0-42e3-b211-a52a5c94f77f req-b5a01589-04ea-48a4-b211-ae6453230803 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032862 Jun 16 17:32:06.590715 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 455/910] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:32:26.025683 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=5 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:26.026570 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=11 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:26.031062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ada58616-b707-4108-9488-95bbc4460370 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:32:26.031593 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ada58616-b707-4108-9488-95bbc4460370 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:26.038513 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ada58616-b707-4108-9488-95bbc4460370 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:26.038956 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ada58616-b707-4108-9488-95bbc4460370 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:26.039710 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ada58616-b707-4108-9488-95bbc4460370 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:26.040138 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ada58616-b707-4108-9488-95bbc4460370 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:26.063344 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.objects.instance [None req-ada58616-b707-4108-9488-95bbc4460370 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lazy-loading 'flavor' on Instance uuid 1cc6f984-945e-4244-b25d-45c9022782dd {{(pid=117552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:32:26.148208 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ada58616-b707-4108-9488-95bbc4460370 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "POST /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd/action" status: 202 len: 0 microversion: 2.1 time: 0.120235 Jun 16 17:32:26.148208 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 456/911] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jun 16 17:32:26 2022] POST /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:32:26.152386 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=3 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:26.153364 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=9 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:26.159840 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-1c216f7e-015b-4705-b894-045f0ddfae78 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:26.160561 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-1c216f7e-015b-4705-b894-045f0ddfae78 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:26.168092 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1c216f7e-015b-4705-b894-045f0ddfae78 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:26.168536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1c216f7e-015b-4705-b894-045f0ddfae78 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:26.169330 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1c216f7e-015b-4705-b894-045f0ddfae78 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:26.169764 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1c216f7e-015b-4705-b894-045f0ddfae78 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:26.312897 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-1c216f7e-015b-4705-b894-045f0ddfae78 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:26.325062 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-1c216f7e-015b-4705-b894-045f0ddfae78 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1568 microversion: 2.1 time: 0.174598 Jun 16 17:32:26.325778 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 456/912] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:26 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:27.345823 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-332df1b1-c056-4cf3-bc1e-19e493cde2a3 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:27.346460 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-332df1b1-c056-4cf3-bc1e-19e493cde2a3 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:27.354858 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-332df1b1-c056-4cf3-bc1e-19e493cde2a3 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:27.355498 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-332df1b1-c056-4cf3-bc1e-19e493cde2a3 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:27.356324 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-332df1b1-c056-4cf3-bc1e-19e493cde2a3 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:27.356794 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-332df1b1-c056-4cf3-bc1e-19e493cde2a3 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:27.508517 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-332df1b1-c056-4cf3-bc1e-19e493cde2a3 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:27.516331 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-332df1b1-c056-4cf3-bc1e-19e493cde2a3 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1568 microversion: 2.1 time: 0.175545 Jun 16 17:32:27.516922 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 457/913] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:27 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:28.533938 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-dab60ee4-b80c-4679-acc8-d95fe8869b95 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:28.534564 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-dab60ee4-b80c-4679-acc8-d95fe8869b95 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:28.542225 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-dab60ee4-b80c-4679-acc8-d95fe8869b95 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:28.542670 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-dab60ee4-b80c-4679-acc8-d95fe8869b95 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:28.543738 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-dab60ee4-b80c-4679-acc8-d95fe8869b95 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:28.544255 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-dab60ee4-b80c-4679-acc8-d95fe8869b95 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:28.684762 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-dab60ee4-b80c-4679-acc8-d95fe8869b95 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:28.695473 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-dab60ee4-b80c-4679-acc8-d95fe8869b95 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1568 microversion: 2.1 time: 0.165191 Jun 16 17:32:28.695997 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 457/914] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:28 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:29.712707 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-84d4f1d4-a97c-4e8d-a5c4-d6d1afc97e2d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:29.713356 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-84d4f1d4-a97c-4e8d-a5c4-d6d1afc97e2d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:29.720567 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-84d4f1d4-a97c-4e8d-a5c4-d6d1afc97e2d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:29.721018 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-84d4f1d4-a97c-4e8d-a5c4-d6d1afc97e2d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:29.722069 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-84d4f1d4-a97c-4e8d-a5c4-d6d1afc97e2d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:29.722505 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-84d4f1d4-a97c-4e8d-a5c4-d6d1afc97e2d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:29.864024 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-84d4f1d4-a97c-4e8d-a5c4-d6d1afc97e2d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:29.872158 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-84d4f1d4-a97c-4e8d-a5c4-d6d1afc97e2d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1568 microversion: 2.1 time: 0.163862 Jun 16 17:32:29.872727 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 458/915] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:29 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:30.890447 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-ea449cd7-b4fa-4d9f-8ac4-84cf5e83858d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:30.891132 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-ea449cd7-b4fa-4d9f-8ac4-84cf5e83858d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:30.898028 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ea449cd7-b4fa-4d9f-8ac4-84cf5e83858d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:30.898470 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ea449cd7-b4fa-4d9f-8ac4-84cf5e83858d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:30.899227 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ea449cd7-b4fa-4d9f-8ac4-84cf5e83858d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:30.899650 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-ea449cd7-b4fa-4d9f-8ac4-84cf5e83858d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:31.041124 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-ea449cd7-b4fa-4d9f-8ac4-84cf5e83858d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:31.055910 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-ea449cd7-b4fa-4d9f-8ac4-84cf5e83858d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1568 microversion: 2.1 time: 0.169646 Jun 16 17:32:31.056494 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 458/916] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:30 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:32.074390 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ac0e63ed-5884-4231-8513-1338030966f3 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:32.075742 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ac0e63ed-5884-4231-8513-1338030966f3 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:32.084000 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ac0e63ed-5884-4231-8513-1338030966f3 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:32.084369 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ac0e63ed-5884-4231-8513-1338030966f3 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:32.085143 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ac0e63ed-5884-4231-8513-1338030966f3 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:32.085606 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ac0e63ed-5884-4231-8513-1338030966f3 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:32.234862 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ac0e63ed-5884-4231-8513-1338030966f3 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:32.248400 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ac0e63ed-5884-4231-8513-1338030966f3 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1568 microversion: 2.1 time: 0.178663 Jun 16 17:32:32.249044 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 459/917] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:32 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:33.268793 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-9dd414ea-e8bc-476e-b5fe-4534c090a1ea tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:33.270313 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-9dd414ea-e8bc-476e-b5fe-4534c090a1ea tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:33.276991 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9dd414ea-e8bc-476e-b5fe-4534c090a1ea tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:33.277497 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9dd414ea-e8bc-476e-b5fe-4534c090a1ea tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:33.278264 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9dd414ea-e8bc-476e-b5fe-4534c090a1ea tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:33.278696 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9dd414ea-e8bc-476e-b5fe-4534c090a1ea tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:33.429451 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-9dd414ea-e8bc-476e-b5fe-4534c090a1ea tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:33.438634 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-9dd414ea-e8bc-476e-b5fe-4534c090a1ea tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1568 microversion: 2.1 time: 0.175315 Jun 16 17:32:33.439236 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 459/918] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:33 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:34.455882 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e09a6727-0065-48dd-a3fc-500f900e9451 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:34.456680 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e09a6727-0065-48dd-a3fc-500f900e9451 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:34.464254 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e09a6727-0065-48dd-a3fc-500f900e9451 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:34.464729 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e09a6727-0065-48dd-a3fc-500f900e9451 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:34.465518 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e09a6727-0065-48dd-a3fc-500f900e9451 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:34.465937 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e09a6727-0065-48dd-a3fc-500f900e9451 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:34.614664 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-e09a6727-0065-48dd-a3fc-500f900e9451 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:34.622838 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-e09a6727-0065-48dd-a3fc-500f900e9451 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1568 microversion: 2.1 time: 0.171040 Jun 16 17:32:34.623390 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 460/919] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:34 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:35.641967 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4ebbf60c-8182-48d4-aaf6-de44fdbfa0ca tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:35.642933 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4ebbf60c-8182-48d4-aaf6-de44fdbfa0ca tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:35.649679 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4ebbf60c-8182-48d4-aaf6-de44fdbfa0ca tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:35.650230 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4ebbf60c-8182-48d4-aaf6-de44fdbfa0ca tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:35.650990 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4ebbf60c-8182-48d4-aaf6-de44fdbfa0ca tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:35.651413 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4ebbf60c-8182-48d4-aaf6-de44fdbfa0ca tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:35.795901 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4ebbf60c-8182-48d4-aaf6-de44fdbfa0ca tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:35.804035 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4ebbf60c-8182-48d4-aaf6-de44fdbfa0ca tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1568 microversion: 2.1 time: 0.167119 Jun 16 17:32:35.804607 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 460/920] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:35 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:36.821736 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a50609ef-e600-44ec-b588-85b6ddbf4145 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:36.822375 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a50609ef-e600-44ec-b588-85b6ddbf4145 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:36.829116 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a50609ef-e600-44ec-b588-85b6ddbf4145 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:36.829614 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a50609ef-e600-44ec-b588-85b6ddbf4145 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:36.830535 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a50609ef-e600-44ec-b588-85b6ddbf4145 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:36.831102 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a50609ef-e600-44ec-b588-85b6ddbf4145 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:37.104203 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a50609ef-e600-44ec-b588-85b6ddbf4145 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:37.112560 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a50609ef-e600-44ec-b588-85b6ddbf4145 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1568 microversion: 2.1 time: 0.294609 Jun 16 17:32:37.113488 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 461/921] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:36 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1568 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:38.130362 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-998d844e-82b4-465e-8657-3304ff30fa0d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:38.130943 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-998d844e-82b4-465e-8657-3304ff30fa0d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:38.138145 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-998d844e-82b4-465e-8657-3304ff30fa0d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:38.138585 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-998d844e-82b4-465e-8657-3304ff30fa0d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:38.139340 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-998d844e-82b4-465e-8657-3304ff30fa0d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:38.139761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-998d844e-82b4-465e-8657-3304ff30fa0d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:38.286919 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-998d844e-82b4-465e-8657-3304ff30fa0d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:38.294984 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-998d844e-82b4-465e-8657-3304ff30fa0d tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1568 microversion: 2.1 time: 0.168645 Jun 16 17:32:38.295560 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 461/922] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:38 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:39.320916 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-093d8a8f-4c0d-4231-adde-ebd32685a54b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:39.322191 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-093d8a8f-4c0d-4231-adde-ebd32685a54b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:39.329864 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-093d8a8f-4c0d-4231-adde-ebd32685a54b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:39.330386 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-093d8a8f-4c0d-4231-adde-ebd32685a54b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:39.331174 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-093d8a8f-4c0d-4231-adde-ebd32685a54b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:39.331590 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-093d8a8f-4c0d-4231-adde-ebd32685a54b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:39.487327 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-093d8a8f-4c0d-4231-adde-ebd32685a54b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:39.495685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-093d8a8f-4c0d-4231-adde-ebd32685a54b tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1568 microversion: 2.1 time: 0.185595 Jun 16 17:32:39.495685 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 462/923] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:39 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:40.514280 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-db713db6-6cc1-4448-a727-e6910334c718 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:40.515248 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-db713db6-6cc1-4448-a727-e6910334c718 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:40.521951 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-db713db6-6cc1-4448-a727-e6910334c718 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:40.522386 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-db713db6-6cc1-4448-a727-e6910334c718 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:40.523271 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-db713db6-6cc1-4448-a727-e6910334c718 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:40.523693 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-db713db6-6cc1-4448-a727-e6910334c718 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:40.794581 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-db713db6-6cc1-4448-a727-e6910334c718 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:40.803345 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-db713db6-6cc1-4448-a727-e6910334c718 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1569 microversion: 2.1 time: 0.292519 Jun 16 17:32:40.803345 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 462/924] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:40 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1569 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:32:40.819619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-96f177ad-9d43-41b6-bffa-560d7606daac tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:32:40.820215 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-96f177ad-9d43-41b6-bffa-560d7606daac tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:40.827272 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-96f177ad-9d43-41b6-bffa-560d7606daac tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:40.827740 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-96f177ad-9d43-41b6-bffa-560d7606daac tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:40.828547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-96f177ad-9d43-41b6-bffa-560d7606daac tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:40.828979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-96f177ad-9d43-41b6-bffa-560d7606daac tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:40.919416 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-96f177ad-9d43-41b6-bffa-560d7606daac tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "POST /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd/action" status: 202 len: 0 microversion: 2.1 time: 0.103724 Jun 16 17:32:40.920131 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 463/925] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jun 16 17:32:40 2022] POST /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:32:40.928951 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-6f2cdc52-f0cb-4b5e-8437-6c819eb5cd75 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:40.929588 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-6f2cdc52-f0cb-4b5e-8437-6c819eb5cd75 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:40.936052 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6f2cdc52-f0cb-4b5e-8437-6c819eb5cd75 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:40.936519 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6f2cdc52-f0cb-4b5e-8437-6c819eb5cd75 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:40.937322 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6f2cdc52-f0cb-4b5e-8437-6c819eb5cd75 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:40.937754 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6f2cdc52-f0cb-4b5e-8437-6c819eb5cd75 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:41.122780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6f2cdc52-f0cb-4b5e-8437-6c819eb5cd75 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:41.131352 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-6f2cdc52-f0cb-4b5e-8437-6c819eb5cd75 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1517 microversion: 2.1 time: 0.206919 Jun 16 17:32:41.131942 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 463/926] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:40 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:42.149001 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5b097ba1-ce49-4dfd-9831-c01dba7c9a0f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:42.150274 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-5b097ba1-ce49-4dfd-9831-c01dba7c9a0f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:42.156610 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5b097ba1-ce49-4dfd-9831-c01dba7c9a0f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:42.157060 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5b097ba1-ce49-4dfd-9831-c01dba7c9a0f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:42.157861 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5b097ba1-ce49-4dfd-9831-c01dba7c9a0f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:42.158722 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5b097ba1-ce49-4dfd-9831-c01dba7c9a0f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:42.354288 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5b097ba1-ce49-4dfd-9831-c01dba7c9a0f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:42.363942 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-5b097ba1-ce49-4dfd-9831-c01dba7c9a0f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1519 microversion: 2.1 time: 0.219486 Jun 16 17:32:42.364503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 464/927] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:42 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1519 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:43.384461 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-573aeec7-f1a1-409c-a84e-9950134bf5da tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:43.385448 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-573aeec7-f1a1-409c-a84e-9950134bf5da tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:43.392213 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-573aeec7-f1a1-409c-a84e-9950134bf5da tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:43.392742 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-573aeec7-f1a1-409c-a84e-9950134bf5da tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:43.393546 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-573aeec7-f1a1-409c-a84e-9950134bf5da tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:43.393974 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-573aeec7-f1a1-409c-a84e-9950134bf5da tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:43.540286 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-573aeec7-f1a1-409c-a84e-9950134bf5da tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:43.548909 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-573aeec7-f1a1-409c-a84e-9950134bf5da tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1575 microversion: 2.1 time: 0.168451 Jun 16 17:32:43.549522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 464/928] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:43 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:32:44.262133 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-0db1a78e-e8bf-4724-bf6a-a3b0b33ef75d req-f14f1610-07b9-4ca6-8f49-e234a199b1a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc6f984-945e-4244-b25d-45c9022782dd", "name": "network-vif-unplugged", "status": "completed", "tag": "9ab6739f-6b37-443b-9a2c-8dc7f323433a"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:32:44.272977 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-0db1a78e-e8bf-4724-bf6a-a3b0b33ef75d req-f14f1610-07b9-4ca6-8f49-e234a199b1a7 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:44.273602 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-0db1a78e-e8bf-4724-bf6a-a3b0b33ef75d req-f14f1610-07b9-4ca6-8f49-e234a199b1a7 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:44.286305 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-0db1a78e-e8bf-4724-bf6a-a3b0b33ef75d req-f14f1610-07b9-4ca6-8f49-e234a199b1a7 service nova] Creating event network-vif-unplugged:9ab6739f-6b37-443b-9a2c-8dc7f323433a for instance 1cc6f984-945e-4244-b25d-45c9022782dd on hv-cinder-83735 Jun 16 17:32:44.292456 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-0db1a78e-e8bf-4724-bf6a-a3b0b33ef75d req-f14f1610-07b9-4ca6-8f49-e234a199b1a7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035403 Jun 16 17:32:44.293062 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 465/929] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:32:44.571755 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-92f2b1a4-7256-47cd-891d-e9f6f15d71c7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:44.572855 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-92f2b1a4-7256-47cd-891d-e9f6f15d71c7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:44.581996 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-92f2b1a4-7256-47cd-891d-e9f6f15d71c7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:44.582764 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-92f2b1a4-7256-47cd-891d-e9f6f15d71c7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:44.583529 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-92f2b1a4-7256-47cd-891d-e9f6f15d71c7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:44.583957 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-92f2b1a4-7256-47cd-891d-e9f6f15d71c7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:44.748803 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-92f2b1a4-7256-47cd-891d-e9f6f15d71c7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:44.757290 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-92f2b1a4-7256-47cd-891d-e9f6f15d71c7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1575 microversion: 2.1 time: 0.194003 Jun 16 17:32:44.757891 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 465/930] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:44 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:45.778481 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0d641c12-49e4-475d-85b1-24a14baadb77 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:45.779403 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0d641c12-49e4-475d-85b1-24a14baadb77 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:45.799583 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d641c12-49e4-475d-85b1-24a14baadb77 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:45.800014 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d641c12-49e4-475d-85b1-24a14baadb77 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:45.800788 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d641c12-49e4-475d-85b1-24a14baadb77 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:45.801229 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d641c12-49e4-475d-85b1-24a14baadb77 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:45.946697 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0d641c12-49e4-475d-85b1-24a14baadb77 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:45.955828 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0d641c12-49e4-475d-85b1-24a14baadb77 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1575 microversion: 2.1 time: 0.184796 Jun 16 17:32:45.956425 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 466/931] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:45 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:46.973352 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5a6fb8a0-87e0-4af4-9c0f-ff677ea203e7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:46.974367 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5a6fb8a0-87e0-4af4-9c0f-ff677ea203e7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:46.981046 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5a6fb8a0-87e0-4af4-9c0f-ff677ea203e7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:46.983147 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5a6fb8a0-87e0-4af4-9c0f-ff677ea203e7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:46.983147 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5a6fb8a0-87e0-4af4-9c0f-ff677ea203e7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:46.983147 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5a6fb8a0-87e0-4af4-9c0f-ff677ea203e7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:47.135980 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-5a6fb8a0-87e0-4af4-9c0f-ff677ea203e7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:47.143847 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5a6fb8a0-87e0-4af4-9c0f-ff677ea203e7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1575 microversion: 2.1 time: 0.174770 Jun 16 17:32:47.144412 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 466/932] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:46 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:48.163650 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-572c8012-6522-476d-8d1b-3653a8442088 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:48.164552 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-572c8012-6522-476d-8d1b-3653a8442088 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:48.173245 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-572c8012-6522-476d-8d1b-3653a8442088 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:48.173733 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-572c8012-6522-476d-8d1b-3653a8442088 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:48.174544 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-572c8012-6522-476d-8d1b-3653a8442088 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:48.175009 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-572c8012-6522-476d-8d1b-3653a8442088 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:48.317744 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-572c8012-6522-476d-8d1b-3653a8442088 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:48.325856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-572c8012-6522-476d-8d1b-3653a8442088 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1575 microversion: 2.1 time: 0.168537 Jun 16 17:32:48.326410 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 467/933] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:48 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:49.346423 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-e9b4afe9-1b51-47f9-8a88-7dc4bab6fbd7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:49.347043 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-e9b4afe9-1b51-47f9-8a88-7dc4bab6fbd7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:49.354088 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e9b4afe9-1b51-47f9-8a88-7dc4bab6fbd7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:49.354538 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e9b4afe9-1b51-47f9-8a88-7dc4bab6fbd7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:49.355318 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e9b4afe9-1b51-47f9-8a88-7dc4bab6fbd7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:49.355755 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e9b4afe9-1b51-47f9-8a88-7dc4bab6fbd7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:49.500555 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e9b4afe9-1b51-47f9-8a88-7dc4bab6fbd7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:49.512174 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-e9b4afe9-1b51-47f9-8a88-7dc4bab6fbd7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1575 microversion: 2.1 time: 0.171631 Jun 16 17:32:49.512916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 467/934] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:49 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:50.531533 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-19623368-b18d-4874-ba4c-5db11ca56607 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:50.532279 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-19623368-b18d-4874-ba4c-5db11ca56607 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:50.539548 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-19623368-b18d-4874-ba4c-5db11ca56607 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:50.540161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-19623368-b18d-4874-ba4c-5db11ca56607 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:50.540950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-19623368-b18d-4874-ba4c-5db11ca56607 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:50.541427 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-19623368-b18d-4874-ba4c-5db11ca56607 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:50.649110 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-3b003694-5460-408a-b20c-94dc09b46ecb tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:50.650155 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-3b003694-5460-408a-b20c-94dc09b46ecb tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:50.656674 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3b003694-5460-408a-b20c-94dc09b46ecb tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:50.657129 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3b003694-5460-408a-b20c-94dc09b46ecb tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:50.658610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3b003694-5460-408a-b20c-94dc09b46ecb tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:50.659502 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3b003694-5460-408a-b20c-94dc09b46ecb tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:50.685134 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-3b003694-5460-408a-b20c-94dc09b46ecb tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc/ips" status: 200 len: 148 microversion: 2.1 time: 0.040253 Jun 16 17:32:50.685739 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 468/935] 10.222.0.66 () {58 vars in 1247 bytes} [Thu Jun 16 17:32:50 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:32:50.693944 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-19623368-b18d-4874-ba4c-5db11ca56607 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:50.696563 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-fe52ce12-f9d4-47ae-a498-dcc47b28015d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7822259a-4f9d-44f5-9493-278879f1e351"}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:32:50.697729 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-fe52ce12-f9d4-47ae-a498-dcc47b28015d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:50.702623 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-19623368-b18d-4874-ba4c-5db11ca56607 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1575 microversion: 2.1 time: 0.175718 Jun 16 17:32:50.703334 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 468/936] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:50 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:50.704000 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fe52ce12-f9d4-47ae-a498-dcc47b28015d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:50.704876 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fe52ce12-f9d4-47ae-a498-dcc47b28015d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:50.706026 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fe52ce12-f9d4-47ae-a498-dcc47b28015d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:50.706467 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fe52ce12-f9d4-47ae-a498-dcc47b28015d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:50.802053 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-fe52ce12-f9d4-47ae-a498-dcc47b28015d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] HTTP exception thrown: Invalid volume: volume 7822259a-4f9d-44f5-9493-278879f1e351 is already attached to instances: 4dce5739-2ecb-43f7-a49a-a9870cf2243c Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-fe52ce12-f9d4-47ae-a498-dcc47b28015d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Request method failure captured: Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: POST /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc/os-volume_attachments HTTP/1.1 Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 74 Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2jM6nxeVPJ_wLeywFOVtPZVOjk2Azcj0dSHnDAG1HXTfbt4n-fL381ERvSVeK072jADPqj1sD3G1uOZtdFTAW3_goCrw2fh09FT00PBj6Cln_7T21eu3gbi01NC1WoSQikUS_PWuftzY2MpE3UZ8fXZ0l8IvFGGpbesg0Z3ABVthA4 Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:32:50.803813 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:32:50.805509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7c56d4c430c44df49f48fe0b49ebcbd2", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7c56d4c430c44df49f48fe0b49ebcbd2"}]}] Jun 16 17:32:50.805509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:32:50.805509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:32:50.805509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:32:50.805509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:32:50.805509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:32:50.805509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:32:50.805509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: 642ef5f213254d818de4888cca274311 Jun 16 17:32:50.805509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:32:50.805509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Jun 16 17:32:50.805509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {"volumeAttachment": {"volumeId": "7822259a-4f9d-44f5-9493-278879f1e351"}} Jun 16 17:32:50.805509 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Invalid volume: volume 7822259a-4f9d-44f5-9493-278879f1e351 is already attached to instances: 4dce5739-2ecb-43f7-a49a-a9870cf2243c Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'server_id': 'c8ea27cc-1e25-4130-bf8a-60fbfb4801bc', 'body': {'volumeAttachment': {'volumeId': '7822259a-4f9d-44f5-9493-278879f1e351'}}} Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7822259a-4f9d-44f5-9493-278879f1e351 is already attached to instances: 4dce5739-2ecb-43f7-a49a-a9870cf2243c Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:32:50.806610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7822259a-4f9d-44f5-9493-278879f1e351 is already attached to instances: 4dce5739-2ecb-43f7-a49a-a9870cf2243c Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:32:50.808223 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:32:50.810140 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:32:50.810140 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:32:50.810140 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:32:50.810140 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7822259a-4f9d-44f5-9493-278879f1e351 is already attached to instances: 4dce5739-2ecb-43f7-a49a-a9870cf2243c Jun 16 17:32:50.810140 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:32:50.810140 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-fe52ce12-f9d4-47ae-a498-dcc47b28015d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Returning 400 to user: Invalid volume: volume 7822259a-4f9d-44f5-9493-278879f1e351 is already attached to instances: 4dce5739-2ecb-43f7-a49a-a9870cf2243c {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:32:50.810140 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-fe52ce12-f9d4-47ae-a498-dcc47b28015d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "POST /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112696 Jun 16 17:32:50.810140 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 469/937] 10.222.0.66 () {60 vars in 1322 bytes} [Thu Jun 16 17:32:50 2022] POST /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:32:50.817533 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-3164fdde-02d2-418f-8d4a-7f1d6ca6a587 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:50.818261 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-3164fdde-02d2-418f-8d4a-7f1d6ca6a587 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:50.826836 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3164fdde-02d2-418f-8d4a-7f1d6ca6a587 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:50.827434 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3164fdde-02d2-418f-8d4a-7f1d6ca6a587 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:50.828552 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3164fdde-02d2-418f-8d4a-7f1d6ca6a587 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:50.829399 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3164fdde-02d2-418f-8d4a-7f1d6ca6a587 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:50.874371 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-3164fdde-02d2-418f-8d4a-7f1d6ca6a587 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Going to try to terminate instance {{(pid=117552) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:32:50.894616 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:50.961345 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-3164fdde-02d2-418f-8d4a-7f1d6ca6a587 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 204 len: 0 microversion: 2.1 time: 0.149769 Jun 16 17:32:50.961965 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 469/938] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:32:50 2022] DELETE /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:32:50.972981 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-45f9e672-88cf-40eb-948b-004066642ff0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:50.974564 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-45f9e672-88cf-40eb-948b-004066642ff0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:50.981510 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-45f9e672-88cf-40eb-948b-004066642ff0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:50.982200 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-45f9e672-88cf-40eb-948b-004066642ff0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:50.983748 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-45f9e672-88cf-40eb-948b-004066642ff0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:50.984188 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-45f9e672-88cf-40eb-948b-004066642ff0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:51.128669 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-45f9e672-88cf-40eb-948b-004066642ff0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:51.136505 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-45f9e672-88cf-40eb-948b-004066642ff0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 200 len: 1678 microversion: 2.1 time: 0.170192 Jun 16 17:32:51.137072 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 470/939] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:50 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:51.721919 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7fb5ede4-5495-4622-b6f6-97dd7ed69b35 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:51.722620 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7fb5ede4-5495-4622-b6f6-97dd7ed69b35 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:51.730456 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7fb5ede4-5495-4622-b6f6-97dd7ed69b35 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:51.730915 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7fb5ede4-5495-4622-b6f6-97dd7ed69b35 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:51.731798 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7fb5ede4-5495-4622-b6f6-97dd7ed69b35 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:51.732230 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7fb5ede4-5495-4622-b6f6-97dd7ed69b35 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:51.877188 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7fb5ede4-5495-4622-b6f6-97dd7ed69b35 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:51.885721 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7fb5ede4-5495-4622-b6f6-97dd7ed69b35 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1575 microversion: 2.1 time: 0.168337 Jun 16 17:32:51.886329 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 470/940] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:51 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:52.154636 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f2ff6ba5-1fd1-4f1b-bf27-b9c4de7654c8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:52.155266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f2ff6ba5-1fd1-4f1b-bf27-b9c4de7654c8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:52.164473 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f2ff6ba5-1fd1-4f1b-bf27-b9c4de7654c8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:52.165510 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f2ff6ba5-1fd1-4f1b-bf27-b9c4de7654c8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:52.166422 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f2ff6ba5-1fd1-4f1b-bf27-b9c4de7654c8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:52.166960 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f2ff6ba5-1fd1-4f1b-bf27-b9c4de7654c8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:52.334340 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-f2ff6ba5-1fd1-4f1b-bf27-b9c4de7654c8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:52.338602 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-ea1c96ce-357a-442e-829b-059aa8b79aa2 req-bba9c0e1-453f-48b9-8ddd-e79ea6cfa91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc6f984-945e-4244-b25d-45c9022782dd", "name": "network-vif-plugged", "status": "completed", "tag": "9ab6739f-6b37-443b-9a2c-8dc7f323433a"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:32:52.344668 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f2ff6ba5-1fd1-4f1b-bf27-b9c4de7654c8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 200 len: 1678 microversion: 2.1 time: 0.193498 Jun 16 17:32:52.344990 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 471/941] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:52 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 1678 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:52.347423 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-ea1c96ce-357a-442e-829b-059aa8b79aa2 req-bba9c0e1-453f-48b9-8ddd-e79ea6cfa91b service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:52.348088 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-ea1c96ce-357a-442e-829b-059aa8b79aa2 req-bba9c0e1-453f-48b9-8ddd-e79ea6cfa91b service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:52.360661 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-ea1c96ce-357a-442e-829b-059aa8b79aa2 req-bba9c0e1-453f-48b9-8ddd-e79ea6cfa91b service nova] Creating event network-vif-plugged:9ab6739f-6b37-443b-9a2c-8dc7f323433a for instance 1cc6f984-945e-4244-b25d-45c9022782dd on hv-cinder-83735 Jun 16 17:32:52.368838 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-ea1c96ce-357a-442e-829b-059aa8b79aa2 req-bba9c0e1-453f-48b9-8ddd-e79ea6cfa91b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034253 Jun 16 17:32:52.369743 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 471/942] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:32:52.903601 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-41444b30-488b-40d0-b53f-e919587f048f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:52.904192 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-41444b30-488b-40d0-b53f-e919587f048f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:52.911353 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-41444b30-488b-40d0-b53f-e919587f048f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:52.911796 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-41444b30-488b-40d0-b53f-e919587f048f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:52.912549 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-41444b30-488b-40d0-b53f-e919587f048f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:52.912974 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-41444b30-488b-40d0-b53f-e919587f048f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:53.060772 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-41444b30-488b-40d0-b53f-e919587f048f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:53.064834 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=100 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:53.071650 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-41444b30-488b-40d0-b53f-e919587f048f tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1575 microversion: 2.1 time: 0.171994 Jun 16 17:32:53.072238 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 472/943] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:52 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:53.366381 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-14eadadf-9c70-4861-a22a-3b1022188102 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:53.367067 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-14eadadf-9c70-4861-a22a-3b1022188102 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:53.374863 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-14eadadf-9c70-4861-a22a-3b1022188102 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:53.375524 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-14eadadf-9c70-4861-a22a-3b1022188102 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:53.376550 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-14eadadf-9c70-4861-a22a-3b1022188102 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:53.377227 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-14eadadf-9c70-4861-a22a-3b1022188102 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:53.557934 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-14eadadf-9c70-4861-a22a-3b1022188102 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:53.566827 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-14eadadf-9c70-4861-a22a-3b1022188102 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 200 len: 1678 microversion: 2.1 time: 0.206561 Jun 16 17:32:53.567782 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 472/944] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:53 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:54.091996 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a08f8bde-50f9-4ea1-a6e4-eab0e4345a5e tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:54.092904 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a08f8bde-50f9-4ea1-a6e4-eab0e4345a5e tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:54.100331 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a08f8bde-50f9-4ea1-a6e4-eab0e4345a5e tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:54.100761 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a08f8bde-50f9-4ea1-a6e4-eab0e4345a5e tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:54.101590 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a08f8bde-50f9-4ea1-a6e4-eab0e4345a5e tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:54.102047 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a08f8bde-50f9-4ea1-a6e4-eab0e4345a5e tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:54.263265 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a08f8bde-50f9-4ea1-a6e4-eab0e4345a5e tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:54.276405 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a08f8bde-50f9-4ea1-a6e4-eab0e4345a5e tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1575 microversion: 2.1 time: 0.189777 Jun 16 17:32:54.284323 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 473/945] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:54 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:54.584346 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8ce8792c-10e7-4b99-b91b-7401518bdd46 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:54.585051 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8ce8792c-10e7-4b99-b91b-7401518bdd46 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:54.592394 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ce8792c-10e7-4b99-b91b-7401518bdd46 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:54.592842 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ce8792c-10e7-4b99-b91b-7401518bdd46 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:54.593647 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ce8792c-10e7-4b99-b91b-7401518bdd46 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:54.594082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8ce8792c-10e7-4b99-b91b-7401518bdd46 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:54.819088 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-8ce8792c-10e7-4b99-b91b-7401518bdd46 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:54.836218 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8ce8792c-10e7-4b99-b91b-7401518bdd46 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 200 len: 1678 microversion: 2.1 time: 0.255965 Jun 16 17:32:54.846745 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 473/946] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:54 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 1678 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:55.300452 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-601c383c-9c22-4ab6-a7c6-bf702ad047be tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:55.302969 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-601c383c-9c22-4ab6-a7c6-bf702ad047be tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:55.318195 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-601c383c-9c22-4ab6-a7c6-bf702ad047be tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:55.319410 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-601c383c-9c22-4ab6-a7c6-bf702ad047be tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:55.320508 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-601c383c-9c22-4ab6-a7c6-bf702ad047be tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:55.321295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-601c383c-9c22-4ab6-a7c6-bf702ad047be tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:55.503732 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-601c383c-9c22-4ab6-a7c6-bf702ad047be tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:55.511941 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-601c383c-9c22-4ab6-a7c6-bf702ad047be tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1562 microversion: 2.1 time: 0.217840 Jun 16 17:32:55.523191 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 474/947] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:55 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1562 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:55.544411 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-a4075636-9b58-4bf4-9078-909e82df47ca req-acb0a5b6-aaeb-49ac-b53f-5e6d0c14b903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ea27cc-1e25-4130-bf8a-60fbfb4801bc", "name": "network-vif-deleted", "tag": "fa515d28-8f3c-4376-9029-a6d947163ef0"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:32:55.559118 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-a4075636-9b58-4bf4-9078-909e82df47ca req-acb0a5b6-aaeb-49ac-b53f-5e6d0c14b903 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:55.559561 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-a4075636-9b58-4bf4-9078-909e82df47ca req-acb0a5b6-aaeb-49ac-b53f-5e6d0c14b903 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:55.574080 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-a4075636-9b58-4bf4-9078-909e82df47ca req-acb0a5b6-aaeb-49ac-b53f-5e6d0c14b903 service nova] Creating event network-vif-deleted:fa515d28-8f3c-4376-9029-a6d947163ef0 for instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc on hv-cinder-83735 Jun 16 17:32:55.580637 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-a4075636-9b58-4bf4-9078-909e82df47ca req-acb0a5b6-aaeb-49ac-b53f-5e6d0c14b903 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039652 Jun 16 17:32:55.581193 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 474/948] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:32:55.856713 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7e3e36a8-5a2c-4697-a74d-8bcca3e9ec30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:55.857777 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-7e3e36a8-5a2c-4697-a74d-8bcca3e9ec30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:55.865025 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7e3e36a8-5a2c-4697-a74d-8bcca3e9ec30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:55.865495 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7e3e36a8-5a2c-4697-a74d-8bcca3e9ec30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:55.866278 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7e3e36a8-5a2c-4697-a74d-8bcca3e9ec30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:55.866711 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7e3e36a8-5a2c-4697-a74d-8bcca3e9ec30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:55.901454 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7e3e36a8-5a2c-4697-a74d-8bcca3e9ec30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:55.901964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7e3e36a8-5a2c-4697-a74d-8bcca3e9ec30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:55.902323 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.objects.instance [None req-7e3e36a8-5a2c-4697-a74d-8bcca3e9ec30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lazy-loading 'fault' on Instance uuid c8ea27cc-1e25-4130-bf8a-60fbfb4801bc {{(pid=117553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:32:55.946397 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7e3e36a8-5a2c-4697-a74d-8bcca3e9ec30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:55.954335 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7e3e36a8-5a2c-4697-a74d-8bcca3e9ec30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 200 len: 1331 microversion: 2.1 time: 0.103516 Jun 16 17:32:55.955388 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 475/949] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:55 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:56.972823 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-17f7a2a7-69a6-46e6-a36a-d0a7603bb9b9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:56.973592 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-17f7a2a7-69a6-46e6-a36a-d0a7603bb9b9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:56.975568 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:56.981456 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-17f7a2a7-69a6-46e6-a36a-d0a7603bb9b9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:56.981908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-17f7a2a7-69a6-46e6-a36a-d0a7603bb9b9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:56.982683 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-17f7a2a7-69a6-46e6-a36a-d0a7603bb9b9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:56.983101 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-17f7a2a7-69a6-46e6-a36a-d0a7603bb9b9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:57.000656 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-17f7a2a7-69a6-46e6-a36a-d0a7603bb9b9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] HTTP exception thrown: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-17f7a2a7-69a6-46e6-a36a-d0a7603bb9b9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Request method failure captured: Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc HTTP/1.1 Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2jM6nxeVPJ_wLeywFOVtPZVOjk2Azcj0dSHnDAG1HXTfbt4n-fL381ERvSVeK072jADPqj1sD3G1uOZtdFTAW3_goCrw2fh09FT00PBj6Cln_7T21eu3gbi01NC1WoSQikUS_PWuftzY2MpE3UZ8fXZ0l8IvFGGpbesg0Z3ABVthA4 Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:32:57.003176 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:32:57.005318 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7c56d4c430c44df49f48fe0b49ebcbd2", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7c56d4c430c44df49f48fe0b49ebcbd2"}]}] Jun 16 17:32:57.005318 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:32:57.005318 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:32:57.005318 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:32:57.005318 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:32:57.005318 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:32:57.005318 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:32:57.005318 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 642ef5f213254d818de4888cca274311 Jun 16 17:32:57.005318 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:32:57.005318 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:32:57.005318 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. Jun 16 17:32:57.005318 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': 'c8ea27cc-1e25-4130-bf8a-60fbfb4801bc'} Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:32:57.006339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. Jun 16 17:32:57.008078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:32:57.009501 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-17f7a2a7-69a6-46e6-a36a-d0a7603bb9b9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Returning 404 to user: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:32:57.009501 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-17f7a2a7-69a6-46e6-a36a-d0a7603bb9b9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 404 len: 111 microversion: 2.1 time: 0.036858 Jun 16 17:32:57.009501 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 475/950] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:56 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:32:57.013714 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-09416c1f-c4e8-47f7-a5d7-f70a1d31d963 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '.version_select at 0x7f66b17d8af0>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:57.020392 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=43 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:57.034900 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-09416c1f-c4e8-47f7-a5d7-f70a1d31d963 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-452367967" status: 202 len: 0 microversion: 2.1 time: 0.024906 Jun 16 17:32:57.035497 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 476/951] 10.222.0.66 () {58 vars in 1217 bytes} [Thu Jun 16 17:32:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-452367967 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:32:57.744005 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-09d9c795-1b23-405f-bad9-0851d43a5133 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:57.744484 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-09d9c795-1b23-405f-bad9-0851d43a5133 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:57.752563 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-09d9c795-1b23-405f-bad9-0851d43a5133 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:57.753009 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-09d9c795-1b23-405f-bad9-0851d43a5133 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:57.753802 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-09d9c795-1b23-405f-bad9-0851d43a5133 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:57.754230 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-09d9c795-1b23-405f-bad9-0851d43a5133 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:57.839173 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.objects.instance [None req-09d9c795-1b23-405f-bad9-0851d43a5133 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lazy-loading 'services' on Instance uuid 4dce5739-2ecb-43f7-a49a-a9870cf2243c {{(pid=117552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:32:57.920780 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-09d9c795-1b23-405f-bad9-0851d43a5133 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c/os-volume_attachments/7822259a-4f9d-44f5-9493-278879f1e351" status: 202 len: 0 microversion: 2.1 time: 0.181842 Jun 16 17:32:57.921421 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 476/952] 10.222.0.66 () {58 vars in 1415 bytes} [Thu Jun 16 17:32:57 2022] DELETE /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c/os-volume_attachments/7822259a-4f9d-44f5-9493-278879f1e351 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:32:57.931903 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-1904706b-66ee-4ebe-917e-85c0c7edd09f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:57.933041 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-1904706b-66ee-4ebe-917e-85c0c7edd09f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:57.940152 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1904706b-66ee-4ebe-917e-85c0c7edd09f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:57.940390 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1904706b-66ee-4ebe-917e-85c0c7edd09f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:57.941505 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1904706b-66ee-4ebe-917e-85c0c7edd09f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:57.941992 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-1904706b-66ee-4ebe-917e-85c0c7edd09f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:57.980716 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-1904706b-66ee-4ebe-917e-85c0c7edd09f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054677 Jun 16 17:32:57.981312 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 477/953] 10.222.0.66 () {58 vars in 1301 bytes} [Thu Jun 16 17:32:57 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:32:58.994099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ee5d0fab-ddae-481c-a409-568d44f4ebf5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:58.995306 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ee5d0fab-ddae-481c-a409-568d44f4ebf5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:59.002167 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ee5d0fab-ddae-481c-a409-568d44f4ebf5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:59.002619 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ee5d0fab-ddae-481c-a409-568d44f4ebf5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:59.003372 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ee5d0fab-ddae-481c-a409-568d44f4ebf5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:59.003828 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ee5d0fab-ddae-481c-a409-568d44f4ebf5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:59.034680 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ee5d0fab-ddae-481c-a409-568d44f4ebf5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045530 Jun 16 17:32:59.035235 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 477/954] 10.222.0.66 () {58 vars in 1301 bytes} [Thu Jun 16 17:32:58 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:32:59.095152 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4b8f5753-882d-4815-b45c-4c4beb8dee53 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:59.095879 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4b8f5753-882d-4815-b45c-4c4beb8dee53 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:59.102675 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4b8f5753-882d-4815-b45c-4c4beb8dee53 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:59.103115 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4b8f5753-882d-4815-b45c-4c4beb8dee53 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:59.103870 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4b8f5753-882d-4815-b45c-4c4beb8dee53 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:59.104318 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4b8f5753-882d-4815-b45c-4c4beb8dee53 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:59.131963 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4b8f5753-882d-4815-b45c-4c4beb8dee53 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Going to try to terminate instance {{(pid=117553) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:32:59.221997 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4b8f5753-882d-4815-b45c-4c4beb8dee53 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c" status: 204 len: 0 microversion: 2.1 time: 0.130309 Jun 16 17:32:59.223435 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 478/955] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:32:59 2022] DELETE /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:32:59.231738 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-3d72398a-06d8-4778-a636-7a2098ffb074 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:59.232355 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-3d72398a-06d8-4778-a636-7a2098ffb074 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:32:59.240339 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3d72398a-06d8-4778-a636-7a2098ffb074 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:59.240766 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3d72398a-06d8-4778-a636-7a2098ffb074 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:59.241629 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3d72398a-06d8-4778-a636-7a2098ffb074 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:59.242060 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3d72398a-06d8-4778-a636-7a2098ffb074 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:59.386704 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-3d72398a-06d8-4778-a636-7a2098ffb074 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:32:59.394910 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-3d72398a-06d8-4778-a636-7a2098ffb074 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c" status: 200 len: 1681 microversion: 2.1 time: 0.167078 Jun 16 17:32:59.395469 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 478/956] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:32:59 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:33:00.413376 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-e6bf4fb3-afe1-4943-a862-4b5efae7c9aa tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:00.414073 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-e6bf4fb3-afe1-4943-a862-4b5efae7c9aa tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:00.421123 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e6bf4fb3-afe1-4943-a862-4b5efae7c9aa tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:00.421610 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e6bf4fb3-afe1-4943-a862-4b5efae7c9aa tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:00.422378 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e6bf4fb3-afe1-4943-a862-4b5efae7c9aa tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:00.422811 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-e6bf4fb3-afe1-4943-a862-4b5efae7c9aa tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:00.578970 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-e6bf4fb3-afe1-4943-a862-4b5efae7c9aa tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:00.587692 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-e6bf4fb3-afe1-4943-a862-4b5efae7c9aa tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c" status: 200 len: 1681 microversion: 2.1 time: 0.179014 Jun 16 17:33:00.588253 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 479/957] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:00 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:33:01.607812 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ccbe1da9-2495-467c-8bf8-51d77d71bf53 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:01.612135 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ccbe1da9-2495-467c-8bf8-51d77d71bf53 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:01.616127 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ccbe1da9-2495-467c-8bf8-51d77d71bf53 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:01.616628 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ccbe1da9-2495-467c-8bf8-51d77d71bf53 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:01.617592 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ccbe1da9-2495-467c-8bf8-51d77d71bf53 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:01.618024 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ccbe1da9-2495-467c-8bf8-51d77d71bf53 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:01.692635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ccbe1da9-2495-467c-8bf8-51d77d71bf53 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:01.703835 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ccbe1da9-2495-467c-8bf8-51d77d71bf53 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c" status: 200 len: 1613 microversion: 2.1 time: 0.101553 Jun 16 17:33:01.705858 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 479/958] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:01 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c => generated 1613 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:33:01.984040 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-f2162391-0ba0-4109-89c7-8bc9a35c39c3 req-77f6ad18-90e8-4948-a730-fdd2e90c5a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dce5739-2ecb-43f7-a49a-a9870cf2243c", "name": "network-vif-deleted", "tag": "f5cc2aae-859d-43dd-a5a3-7df6d8cbc7fa"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:33:02.000412 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-f2162391-0ba0-4109-89c7-8bc9a35c39c3 req-77f6ad18-90e8-4948-a730-fdd2e90c5a2b service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:02.001163 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-f2162391-0ba0-4109-89c7-8bc9a35c39c3 req-77f6ad18-90e8-4948-a730-fdd2e90c5a2b service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:02.021611 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-f2162391-0ba0-4109-89c7-8bc9a35c39c3 req-77f6ad18-90e8-4948-a730-fdd2e90c5a2b service nova] Creating event network-vif-deleted:f5cc2aae-859d-43dd-a5a3-7df6d8cbc7fa for instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c on hv-cinder-83735 Jun 16 17:33:02.030069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-f2162391-0ba0-4109-89c7-8bc9a35c39c3 req-77f6ad18-90e8-4948-a730-fdd2e90c5a2b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050250 Jun 16 17:33:02.031469 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 480/959] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:33:02.723980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-3ab2dd4a-723e-4ded-ae84-dfa16c307f43 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:02.724609 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-3ab2dd4a-723e-4ded-ae84-dfa16c307f43 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:02.735001 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3ab2dd4a-723e-4ded-ae84-dfa16c307f43 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:02.735711 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3ab2dd4a-723e-4ded-ae84-dfa16c307f43 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:02.737301 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3ab2dd4a-723e-4ded-ae84-dfa16c307f43 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:02.738485 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3ab2dd4a-723e-4ded-ae84-dfa16c307f43 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:02.762096 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-3ab2dd4a-723e-4ded-ae84-dfa16c307f43 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] HTTP exception thrown: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-3ab2dd4a-723e-4ded-ae84-dfa16c307f43 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Request method failure captured: Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c HTTP/1.1 Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2jM6nxeVPJ_wLeywFOVtPZVOjk2Azcj0dSHnDAG1HXTfbt4n-fL381ERvSVeK072jADPqj1sD3G1uOZtdFTAW3_goCrw2fh09FT00PBj6Cln_7T21eu3gbi01NC1WoSQikUS_PWuftzY2MpE3UZ8fXZ0l8IvFGGpbesg0Z3ABVthA4 Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:33:02.764819 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:33:02.766547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7c56d4c430c44df49f48fe0b49ebcbd2", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7c56d4c430c44df49f48fe0b49ebcbd2"}]}] Jun 16 17:33:02.766547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:33:02.766547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:33:02.766547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:33:02.766547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:33:02.766547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:33:02.766547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:33:02.766547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 642ef5f213254d818de4888cca274311 Jun 16 17:33:02.766547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:33:02.766547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:33:02.766547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. Jun 16 17:33:02.766547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': '4dce5739-2ecb-43f7-a49a-a9870cf2243c'} Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:33:02.767462 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. Jun 16 17:33:02.769952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:33:02.771780 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-3ab2dd4a-723e-4ded-ae84-dfa16c307f43 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Returning 404 to user: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:33:02.771780 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-3ab2dd4a-723e-4ded-ae84-dfa16c307f43 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c" status: 404 len: 111 microversion: 2.1 time: 0.046726 Jun 16 17:33:02.771780 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 480/960] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:02 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:33:02.781976 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b6ced5f0-396c-43db-b329-629a3e71c56e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '.version_select at 0x7f66b16fe9d0>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:02.808833 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b6ced5f0-396c-43db-b329-629a3e71c56e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732637549" status: 202 len: 0 microversion: 2.1 time: 0.034479 Jun 16 17:33:02.809493 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 481/961] 10.222.0.66 () {58 vars in 1220 bytes} [Thu Jun 16 17:33:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732637549 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:33:03.529376 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-58c32045-3bef-4d45-9831-f1595c4886be tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Action: 'create', calling method: .version_select at 0x7f66b1537700>, body: {"keypair": {"name": "tempest-keypair-877487804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWd206cBDSwR6bev2wOG8mfBUiqiYaQdstXPZibYv8ZA6J7oOZ6dGsfZ5IRSbRv0joSXu/AwlyoQUq5qH7XuVZY/UUHuLk/TzTn5t/PghD53rtR4uKvZNXy39/gJTViow=="}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:33:03.543977 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-58c32045-3bef-4d45-9831-f1595c4886be tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Getting quotas for project 7c56d4c430c44df49f48fe0b49ebcbd2. Resources: {'key_pairs'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:33:03.548444 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-58c32045-3bef-4d45-9831-f1595c4886be tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Getting quotas for user 642ef5f213254d818de4888cca274311 and project 7c56d4c430c44df49f48fe0b49ebcbd2. Resources: {'key_pairs'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:33:03.572710 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-58c32045-3bef-4d45-9831-f1595c4886be tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047144 Jun 16 17:33:03.573560 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 481/962] 10.222.0.66 () {60 vars in 1158 bytes} [Thu Jun 16 17:33:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:33:04.911921 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a440742c-2b4b-4166-a8b7-a8ef41ea60e3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1267328351", "imageRef": "c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38b62bc9-5cad-4b9e-8181-628535658100"}], "security_groups": [{"name": "tempest-securitygroup--259158112"}], "key_name": "tempest-keypair-877487804", "user_data": "}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:33:05.038248 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.network.neutron [None req-a440742c-2b4b-4166-a8b7-a8ef41ea60e3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] validate_networks() for [('38b62bc9-5cad-4b9e-8181-628535658100', None, None, None, None, None)] {{(pid=117553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:33:05.488304 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-a440742c-2b4b-4166-a8b7-a8ef41ea60e3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Flavor limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:33:05.488728 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-a440742c-2b4b-4166-a8b7-a8ef41ea60e3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Image limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:33:05.489219 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-a440742c-2b4b-4166-a8b7-a8ef41ea60e3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Flavor pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:33:05.489641 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-a440742c-2b4b-4166-a8b7-a8ef41ea60e3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Image pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:33:05.491751 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-a440742c-2b4b-4166-a8b7-a8ef41ea60e3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:33:05.499873 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a440742c-2b4b-4166-a8b7-a8ef41ea60e3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:05.500338 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a440742c-2b4b-4166-a8b7-a8ef41ea60e3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:05.501116 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a440742c-2b4b-4166-a8b7-a8ef41ea60e3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:05.501659 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a440742c-2b4b-4166-a8b7-a8ef41ea60e3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:05.520537 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-a440742c-2b4b-4166-a8b7-a8ef41ea60e3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Getting quotas for project 7c56d4c430c44df49f48fe0b49ebcbd2. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:33:05.525247 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-a440742c-2b4b-4166-a8b7-a8ef41ea60e3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Getting quotas for user 642ef5f213254d818de4888cca274311 and project 7c56d4c430c44df49f48fe0b49ebcbd2. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:33:05.537199 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a440742c-2b4b-4166-a8b7-a8ef41ea60e3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Going to run 1 instances... {{(pid=117553) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:33:05.539591 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a440742c-2b4b-4166-a8b7-a8ef41ea60e3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:33:05.587506 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a440742c-2b4b-4166-a8b7-a8ef41ea60e3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.680493 Jun 16 17:33:05.588069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 482/963] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:33:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:33:05.598736 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-576491e3-22ea-46b7-a9ee-f2a897babb17 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:05.599337 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-576491e3-22ea-46b7-a9ee-f2a897babb17 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:05.658656 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-576491e3-22ea-46b7-a9ee-f2a897babb17 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:05.667613 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-576491e3-22ea-46b7-a9ee-f2a897babb17 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68" status: 200 len: 1241 microversion: 2.1 time: 0.073281 Jun 16 17:33:05.668184 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 482/964] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:05 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:33:06.685749 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2f0be2c1-9ecd-4017-a444-c94ba075b3b3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:06.686437 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2f0be2c1-9ecd-4017-a444-c94ba075b3b3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:06.694142 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2f0be2c1-9ecd-4017-a444-c94ba075b3b3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:06.694580 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2f0be2c1-9ecd-4017-a444-c94ba075b3b3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:06.695376 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2f0be2c1-9ecd-4017-a444-c94ba075b3b3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:06.695804 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2f0be2c1-9ecd-4017-a444-c94ba075b3b3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:06.770356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2f0be2c1-9ecd-4017-a444-c94ba075b3b3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:06.778448 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2f0be2c1-9ecd-4017-a444-c94ba075b3b3 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68" status: 200 len: 1301 microversion: 2.1 time: 0.096890 Jun 16 17:33:06.788702 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 483/965] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:06 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 => generated 1301 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:33:07.796200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c91d3c5d-cf6a-4405-b6f0-6a60c6fa40c0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:07.796885 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c91d3c5d-cf6a-4405-b6f0-6a60c6fa40c0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:07.803995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c91d3c5d-cf6a-4405-b6f0-6a60c6fa40c0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:07.804439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c91d3c5d-cf6a-4405-b6f0-6a60c6fa40c0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:07.805272 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c91d3c5d-cf6a-4405-b6f0-6a60c6fa40c0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:07.805728 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c91d3c5d-cf6a-4405-b6f0-6a60c6fa40c0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:08.027060 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c91d3c5d-cf6a-4405-b6f0-6a60c6fa40c0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:08.035292 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c91d3c5d-cf6a-4405-b6f0-6a60c6fa40c0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68" status: 200 len: 1366 microversion: 2.1 time: 0.243005 Jun 16 17:33:08.036066 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 483/966] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:07 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:33:08.411169 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-b31f0680-9285-4a70-9f3a-8797c27e81b8 req-530dcf25-8f1b-4cf4-9a29-996d269a225b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db95418d-ea53-4a5b-b942-3809e3cfec68", "tag": "4d5b77eb-61af-4c99-a4e0-4afb006eb6b8"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:33:08.421811 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-b31f0680-9285-4a70-9f3a-8797c27e81b8 req-530dcf25-8f1b-4cf4-9a29-996d269a225b service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:08.422418 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-b31f0680-9285-4a70-9f3a-8797c27e81b8 req-530dcf25-8f1b-4cf4-9a29-996d269a225b service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:08.434881 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-b31f0680-9285-4a70-9f3a-8797c27e81b8 req-530dcf25-8f1b-4cf4-9a29-996d269a225b service nova] Creating event network-changed:4d5b77eb-61af-4c99-a4e0-4afb006eb6b8 for instance db95418d-ea53-4a5b-b942-3809e3cfec68 on hv-cinder-83735 Jun 16 17:33:08.439985 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-b31f0680-9285-4a70-9f3a-8797c27e81b8 req-530dcf25-8f1b-4cf4-9a29-996d269a225b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108987 Jun 16 17:33:08.441218 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 484/967] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:33:09.054530 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a9e4d6db-4ae4-438d-8cba-9daaea64d924 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:09.055109 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a9e4d6db-4ae4-438d-8cba-9daaea64d924 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:09.062227 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a9e4d6db-4ae4-438d-8cba-9daaea64d924 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:09.062668 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a9e4d6db-4ae4-438d-8cba-9daaea64d924 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:09.063432 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a9e4d6db-4ae4-438d-8cba-9daaea64d924 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:09.063925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a9e4d6db-4ae4-438d-8cba-9daaea64d924 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:09.208820 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a9e4d6db-4ae4-438d-8cba-9daaea64d924 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:09.216831 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a9e4d6db-4ae4-438d-8cba-9daaea64d924 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68" status: 200 len: 1366 microversion: 2.1 time: 0.167386 Jun 16 17:33:09.217428 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 484/968] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:09 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:33:10.235924 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-6091739c-d8c0-4fca-9dfd-a2947f04d72f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:10.236898 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-6091739c-d8c0-4fca-9dfd-a2947f04d72f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:10.244490 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6091739c-d8c0-4fca-9dfd-a2947f04d72f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:10.244923 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6091739c-d8c0-4fca-9dfd-a2947f04d72f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:10.245721 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6091739c-d8c0-4fca-9dfd-a2947f04d72f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:10.246147 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-6091739c-d8c0-4fca-9dfd-a2947f04d72f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:10.411058 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-6091739c-d8c0-4fca-9dfd-a2947f04d72f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:10.421441 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-6091739c-d8c0-4fca-9dfd-a2947f04d72f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68" status: 200 len: 1366 microversion: 2.1 time: 0.190377 Jun 16 17:33:10.422030 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 485/969] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:10 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:33:11.442924 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-39b8279d-1d09-4753-874c-ee11e1f8c87c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:11.443848 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-39b8279d-1d09-4753-874c-ee11e1f8c87c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:11.454708 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-39b8279d-1d09-4753-874c-ee11e1f8c87c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:11.455161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-39b8279d-1d09-4753-874c-ee11e1f8c87c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:11.455947 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-39b8279d-1d09-4753-874c-ee11e1f8c87c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:11.456381 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-39b8279d-1d09-4753-874c-ee11e1f8c87c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:11.591093 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-39b8279d-1d09-4753-874c-ee11e1f8c87c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:11.599085 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-39b8279d-1d09-4753-874c-ee11e1f8c87c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68" status: 200 len: 1366 microversion: 2.1 time: 0.162063 Jun 16 17:33:11.599655 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 485/970] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:11 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:33:12.456000 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-f3eb94ea-a864-4e5c-8bfc-10ab2fa2007e req-7b520f2c-7c22-4d2e-9b8d-301df43f650e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db95418d-ea53-4a5b-b942-3809e3cfec68", "name": "network-vif-plugged", "status": "completed", "tag": "4d5b77eb-61af-4c99-a4e0-4afb006eb6b8"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:33:12.464855 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-f3eb94ea-a864-4e5c-8bfc-10ab2fa2007e req-7b520f2c-7c22-4d2e-9b8d-301df43f650e service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:12.465442 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-f3eb94ea-a864-4e5c-8bfc-10ab2fa2007e req-7b520f2c-7c22-4d2e-9b8d-301df43f650e service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:12.478236 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-f3eb94ea-a864-4e5c-8bfc-10ab2fa2007e req-7b520f2c-7c22-4d2e-9b8d-301df43f650e service nova] Creating event network-vif-plugged:4d5b77eb-61af-4c99-a4e0-4afb006eb6b8 for instance db95418d-ea53-4a5b-b942-3809e3cfec68 on hv-cinder-83735 Jun 16 17:33:12.484232 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-f3eb94ea-a864-4e5c-8bfc-10ab2fa2007e req-7b520f2c-7c22-4d2e-9b8d-301df43f650e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032311 Jun 16 17:33:12.484829 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 486/971] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:33:12.616581 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-4d70456d-1177-43bf-9e16-bcea0845133e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:12.617216 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-4d70456d-1177-43bf-9e16-bcea0845133e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:12.623800 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4d70456d-1177-43bf-9e16-bcea0845133e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:12.624256 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4d70456d-1177-43bf-9e16-bcea0845133e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:12.630672 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4d70456d-1177-43bf-9e16-bcea0845133e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:12.630672 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4d70456d-1177-43bf-9e16-bcea0845133e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:12.809909 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-4d70456d-1177-43bf-9e16-bcea0845133e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:12.818146 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-4d70456d-1177-43bf-9e16-bcea0845133e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68" status: 200 len: 1366 microversion: 2.1 time: 0.205760 Jun 16 17:33:12.818709 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 486/972] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:12 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:33:13.839831 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c04c58d9-0c08-49bf-a0c9-0bfeb2af070b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:13.840904 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c04c58d9-0c08-49bf-a0c9-0bfeb2af070b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:13.851977 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c04c58d9-0c08-49bf-a0c9-0bfeb2af070b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:13.851977 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c04c58d9-0c08-49bf-a0c9-0bfeb2af070b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:13.852778 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c04c58d9-0c08-49bf-a0c9-0bfeb2af070b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:13.853372 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c04c58d9-0c08-49bf-a0c9-0bfeb2af070b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:13.998356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c04c58d9-0c08-49bf-a0c9-0bfeb2af070b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:14.007229 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c04c58d9-0c08-49bf-a0c9-0bfeb2af070b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68" status: 200 len: 1366 microversion: 2.1 time: 0.174605 Jun 16 17:33:14.007787 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 487/973] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:13 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:33:15.029236 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0d683753-7085-4b0c-ac19-bcc8277333bd tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:15.029865 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0d683753-7085-4b0c-ac19-bcc8277333bd tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:15.036666 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d683753-7085-4b0c-ac19-bcc8277333bd tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:15.037115 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d683753-7085-4b0c-ac19-bcc8277333bd tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:15.037908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d683753-7085-4b0c-ac19-bcc8277333bd tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:15.038340 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d683753-7085-4b0c-ac19-bcc8277333bd tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:15.177592 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-0d683753-7085-4b0c-ac19-bcc8277333bd tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:15.188406 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0d683753-7085-4b0c-ac19-bcc8277333bd tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68" status: 200 len: 1556 microversion: 2.1 time: 0.163785 Jun 16 17:33:15.189264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 487/974] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:15 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:33:15.210750 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-33225c27-cf6a-4b73-80f1-5cd3e37d66fe tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:15.211371 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-33225c27-cf6a-4b73-80f1-5cd3e37d66fe tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:15.218228 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-33225c27-cf6a-4b73-80f1-5cd3e37d66fe tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:15.218678 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-33225c27-cf6a-4b73-80f1-5cd3e37d66fe tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:15.219454 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-33225c27-cf6a-4b73-80f1-5cd3e37d66fe tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:15.219889 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-33225c27-cf6a-4b73-80f1-5cd3e37d66fe tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:15.306415 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-33225c27-cf6a-4b73-80f1-5cd3e37d66fe tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099572 Jun 16 17:33:15.307027 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 488/975] 10.222.0.66 () {58 vars in 1274 bytes} [Thu Jun 16 17:33:15 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:33:16.532452 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=6 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:33:16.599463 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-ead022ec-cc5c-4008-ac76-59f0d4945b61 req-3fb979a1-4b82-477a-b721-0d9cfda01722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db95418d-ea53-4a5b-b942-3809e3cfec68", "tag": "4d5b77eb-61af-4c99-a4e0-4afb006eb6b8"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:33:16.608045 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-ead022ec-cc5c-4008-ac76-59f0d4945b61 req-3fb979a1-4b82-477a-b721-0d9cfda01722 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:16.608485 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-ead022ec-cc5c-4008-ac76-59f0d4945b61 req-3fb979a1-4b82-477a-b721-0d9cfda01722 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:16.624388 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-ead022ec-cc5c-4008-ac76-59f0d4945b61 req-3fb979a1-4b82-477a-b721-0d9cfda01722 service nova] Creating event network-changed:4d5b77eb-61af-4c99-a4e0-4afb006eb6b8 for instance db95418d-ea53-4a5b-b942-3809e3cfec68 on hv-cinder-83735 Jun 16 17:33:16.629710 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-ead022ec-cc5c-4008-ac76-59f0d4945b61 req-3fb979a1-4b82-477a-b721-0d9cfda01722 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101713 Jun 16 17:33:16.630288 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 488/976] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:33:32.965386 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:33:32.966707 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=6 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:33:32.967962 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:33:32.968858 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:33:32.969003 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:33:32.970355 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:33:32.974865 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-88c699bd-eb80-40d5-b1d4-a2c93f646fdb req-49089090-9f08-41bf-93c4-24d6e8844d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846547de-f4c6-43da-80ab-05da7d9fccf3", "tag": "36fcbcc2-2d79-4ffe-9727-2ad369c03b4a"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:33:32.975147 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5a9b5e9d-7227-474f-b151-a9d35568d71a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:32.975744 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5a9b5e9d-7227-474f-b151-a9d35568d71a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:32.985041 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5a9b5e9d-7227-474f-b151-a9d35568d71a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:32.985868 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5a9b5e9d-7227-474f-b151-a9d35568d71a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:32.986442 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-88c699bd-eb80-40d5-b1d4-a2c93f646fdb req-49089090-9f08-41bf-93c4-24d6e8844d5c service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:32.986929 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-88c699bd-eb80-40d5-b1d4-a2c93f646fdb req-49089090-9f08-41bf-93c4-24d6e8844d5c service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:32.987106 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5a9b5e9d-7227-474f-b151-a9d35568d71a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:32.987795 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5a9b5e9d-7227-474f-b151-a9d35568d71a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:33.002490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-88c699bd-eb80-40d5-b1d4-a2c93f646fdb req-49089090-9f08-41bf-93c4-24d6e8844d5c service nova] Creating event network-changed:36fcbcc2-2d79-4ffe-9727-2ad369c03b4a for instance 846547de-f4c6-43da-80ab-05da7d9fccf3 on hv-cinder-83735 Jun 16 17:33:33.008726 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-88c699bd-eb80-40d5-b1d4-a2c93f646fdb req-49089090-9f08-41bf-93c4-24d6e8844d5c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041036 Jun 16 17:33:33.009364 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 489/977] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:33:33.020601 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5a9b5e9d-7227-474f-b151-a9d35568d71a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Going to try to terminate instance {{(pid=117553) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:33:33.113898 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5a9b5e9d-7227-474f-b151-a9d35568d71a tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "DELETE /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 204 len: 0 microversion: 2.1 time: 0.149071 Jun 16 17:33:33.118294 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 489/978] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:33:32 2022] DELETE /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:33:33.124065 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-6c30084d-b055-4e9e-ac64-5dc9b825760b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:33.124734 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-6c30084d-b055-4e9e-ac64-5dc9b825760b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:33.131926 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6c30084d-b055-4e9e-ac64-5dc9b825760b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:33.132373 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6c30084d-b055-4e9e-ac64-5dc9b825760b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:33.133428 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6c30084d-b055-4e9e-ac64-5dc9b825760b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:33.134112 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6c30084d-b055-4e9e-ac64-5dc9b825760b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:33.308082 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-6c30084d-b055-4e9e-ac64-5dc9b825760b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:33.316507 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-6c30084d-b055-4e9e-ac64-5dc9b825760b tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1578 microversion: 2.1 time: 0.196716 Jun 16 17:33:33.317091 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 490/979] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:33 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1578 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:33:34.335230 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-fee43b48-0fbe-422f-9628-3e2fee760b7d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:34.335916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-fee43b48-0fbe-422f-9628-3e2fee760b7d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:34.343190 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fee43b48-0fbe-422f-9628-3e2fee760b7d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:34.343569 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fee43b48-0fbe-422f-9628-3e2fee760b7d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:34.344932 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fee43b48-0fbe-422f-9628-3e2fee760b7d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:34.345424 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fee43b48-0fbe-422f-9628-3e2fee760b7d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:34.517696 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-fee43b48-0fbe-422f-9628-3e2fee760b7d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:34.527749 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-fee43b48-0fbe-422f-9628-3e2fee760b7d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1578 microversion: 2.1 time: 0.196705 Jun 16 17:33:34.528620 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 490/980] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:34 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1578 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:33:35.547660 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-ebf6ded7-100f-49ad-96a4-4650b3cdbb80 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:35.548632 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-ebf6ded7-100f-49ad-96a4-4650b3cdbb80 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:35.556682 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ebf6ded7-100f-49ad-96a4-4650b3cdbb80 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:35.557140 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ebf6ded7-100f-49ad-96a4-4650b3cdbb80 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:35.558097 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ebf6ded7-100f-49ad-96a4-4650b3cdbb80 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:35.558603 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-ebf6ded7-100f-49ad-96a4-4650b3cdbb80 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:35.715357 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-ebf6ded7-100f-49ad-96a4-4650b3cdbb80 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:35.723428 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-ebf6ded7-100f-49ad-96a4-4650b3cdbb80 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1578 microversion: 2.1 time: 0.180402 Jun 16 17:33:35.723957 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 491/981] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:35 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1578 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:33:36.669560 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-b53e0c49-837d-42bd-80dc-355548341865 req-241338e3-2290-46e4-a889-b38450d96a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846547de-f4c6-43da-80ab-05da7d9fccf3", "name": "network-vif-deleted", "tag": "36fcbcc2-2d79-4ffe-9727-2ad369c03b4a"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:33:36.680046 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-b53e0c49-837d-42bd-80dc-355548341865 req-241338e3-2290-46e4-a889-b38450d96a2c service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:36.680486 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-b53e0c49-837d-42bd-80dc-355548341865 req-241338e3-2290-46e4-a889-b38450d96a2c service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:36.692836 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-b53e0c49-837d-42bd-80dc-355548341865 req-241338e3-2290-46e4-a889-b38450d96a2c service nova] Creating event network-vif-deleted:36fcbcc2-2d79-4ffe-9727-2ad369c03b4a for instance 846547de-f4c6-43da-80ab-05da7d9fccf3 on hv-cinder-83735 Jun 16 17:33:36.698895 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-b53e0c49-837d-42bd-80dc-355548341865 req-241338e3-2290-46e4-a889-b38450d96a2c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033492 Jun 16 17:33:36.699493 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 491/982] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:33:36.746636 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7023d08e-62f5-4474-b5a8-cce0b8057b6d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:36.747213 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7023d08e-62f5-4474-b5a8-cce0b8057b6d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:36.754204 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7023d08e-62f5-4474-b5a8-cce0b8057b6d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:36.754638 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7023d08e-62f5-4474-b5a8-cce0b8057b6d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:36.755396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7023d08e-62f5-4474-b5a8-cce0b8057b6d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:36.755826 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7023d08e-62f5-4474-b5a8-cce0b8057b6d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:36.822818 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7023d08e-62f5-4474-b5a8-cce0b8057b6d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:36.831048 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7023d08e-62f5-4474-b5a8-cce0b8057b6d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 200 len: 1225 microversion: 2.1 time: 0.088394 Jun 16 17:33:36.831576 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 492/983] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:36 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:33:37.852736 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-3ef2c95f-4b7a-468e-961e-de432f23bb06 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:37.853537 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-3ef2c95f-4b7a-468e-961e-de432f23bb06 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 846547de-f4c6-43da-80ab-05da7d9fccf3] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:37.862974 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3ef2c95f-4b7a-468e-961e-de432f23bb06 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:37.863815 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3ef2c95f-4b7a-468e-961e-de432f23bb06 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:37.864174 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3ef2c95f-4b7a-468e-961e-de432f23bb06 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:37.864617 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3ef2c95f-4b7a-468e-961e-de432f23bb06 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:37.879643 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-3ef2c95f-4b7a-468e-961e-de432f23bb06 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] HTTP exception thrown: Instance 846547de-f4c6-43da-80ab-05da7d9fccf3 could not be found. Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-3ef2c95f-4b7a-468e-961e-de432f23bb06 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Request method failure captured: Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 HTTP/1.1 Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2eFw6_U-ptmuweRKQwrW58d8B_3CgkZ165Jfz1FqCqwUodyV2kbBrfqufcZQUb2LLHllv0IvNEBSlfLrr31_0IlR8cbqRDs3hkA3KBNBR8SlLmCIRmf5gpJIYcsenQ27PlY5_NKbhJUEv4c_6cPSe4ryXG8zIcWdp6KYXNkC1rGups Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: bd1488226a424c6e9e7f94f31b020e4f Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-TestVolumeBootPattern-1350759327 Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:33:37.881383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:33:37.882925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bd1488226a424c6e9e7f94f31b020e4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bd1488226a424c6e9e7f94f31b020e4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bd1488226a424c6e9e7f94f31b020e4f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bd1488226a424c6e9e7f94f31b020e4f"}]}] Jun 16 17:33:37.882925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-TestVolumeBootPattern-1350759327 Jun 16 17:33:37.882925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: bd1488226a424c6e9e7f94f31b020e4f Jun 16 17:33:37.882925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-TestVolumeBootPattern-1350759327 Jun 16 17:33:37.882925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-TestVolumeBootPattern-1350759327-project Jun 16 17:33:37.882925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:33:37.882925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:33:37.882925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: fbbafeb56a4d4fd282275e4198ede783 Jun 16 17:33:37.882925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-TestVolumeBootPattern-1350759327-project Jun 16 17:33:37.882925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:33:37.882925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance 846547de-f4c6-43da-80ab-05da7d9fccf3 could not be found. Jun 16 17:33:37.882925 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': '846547de-f4c6-43da-80ab-05da7d9fccf3'} Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846547de-f4c6-43da-80ab-05da7d9fccf3 could not be found. Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:33:37.883839 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846547de-f4c6-43da-80ab-05da7d9fccf3 could not be found. Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846547de-f4c6-43da-80ab-05da7d9fccf3 could not be found. Jun 16 17:33:37.885462 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:33:37.887023 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-3ef2c95f-4b7a-468e-961e-de432f23bb06 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Returning 404 to user: Instance 846547de-f4c6-43da-80ab-05da7d9fccf3 could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:33:37.887023 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-3ef2c95f-4b7a-468e-961e-de432f23bb06 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3" status: 404 len: 111 microversion: 2.1 time: 0.034317 Jun 16 17:33:37.887023 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 492/984] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:37 2022] GET /compute/v2.1/servers/846547de-f4c6-43da-80ab-05da7d9fccf3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:33:41.034226 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8812fd73-b1e7-43c9-85b5-1e18134e08c9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:41.035439 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8812fd73-b1e7-43c9-85b5-1e18134e08c9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:41.038123 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-5d55aed5-0644-46dd-b646-c2ff633988bf req-e52d5ecd-fd2b-45fd-a35f-3f61083146c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5b6345-48fe-44a0-b917-2b12902e234b", "tag": "ccefb110-1f8f-47f6-a66f-5a8c5114a8dc"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:33:41.043057 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8812fd73-b1e7-43c9-85b5-1e18134e08c9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:41.043847 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8812fd73-b1e7-43c9-85b5-1e18134e08c9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:41.044686 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8812fd73-b1e7-43c9-85b5-1e18134e08c9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:41.045189 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8812fd73-b1e7-43c9-85b5-1e18134e08c9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:41.048238 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-5d55aed5-0644-46dd-b646-c2ff633988bf req-e52d5ecd-fd2b-45fd-a35f-3f61083146c4 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:41.048696 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-5d55aed5-0644-46dd-b646-c2ff633988bf req-e52d5ecd-fd2b-45fd-a35f-3f61083146c4 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:41.061355 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-5d55aed5-0644-46dd-b646-c2ff633988bf req-e52d5ecd-fd2b-45fd-a35f-3f61083146c4 service nova] Creating event network-changed:ccefb110-1f8f-47f6-a66f-5a8c5114a8dc for instance ce5b6345-48fe-44a0-b917-2b12902e234b on hv-cinder-83735 Jun 16 17:33:41.067660 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-5d55aed5-0644-46dd-b646-c2ff633988bf req-e52d5ecd-fd2b-45fd-a35f-3f61083146c4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033073 Jun 16 17:33:41.068483 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 493/985] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:33:41.076030 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8812fd73-b1e7-43c9-85b5-1e18134e08c9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Going to try to terminate instance {{(pid=117552) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:33:41.171433 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8812fd73-b1e7-43c9-85b5-1e18134e08c9 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 204 len: 0 microversion: 2.1 time: 0.141189 Jun 16 17:33:41.181480 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 493/986] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:33:41 2022] DELETE /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:33:41.182281 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-82f1b76b-001c-4188-bc72-3280b76d9fa8 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:41.182987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-82f1b76b-001c-4188-bc72-3280b76d9fa8 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:41.190052 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-82f1b76b-001c-4188-bc72-3280b76d9fa8 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:41.190501 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-82f1b76b-001c-4188-bc72-3280b76d9fa8 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:41.191292 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-82f1b76b-001c-4188-bc72-3280b76d9fa8 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:41.191979 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-82f1b76b-001c-4188-bc72-3280b76d9fa8 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:41.356592 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-82f1b76b-001c-4188-bc72-3280b76d9fa8 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:41.365288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-82f1b76b-001c-4188-bc72-3280b76d9fa8 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1577 microversion: 2.1 time: 0.187718 Jun 16 17:33:41.365863 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 494/987] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:41 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:33:42.384538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-e00996ec-8744-4392-9839-c3a785cf182d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:42.385130 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-e00996ec-8744-4392-9839-c3a785cf182d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:42.392108 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e00996ec-8744-4392-9839-c3a785cf182d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:42.392562 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e00996ec-8744-4392-9839-c3a785cf182d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:42.393379 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e00996ec-8744-4392-9839-c3a785cf182d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:42.393813 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-e00996ec-8744-4392-9839-c3a785cf182d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:42.546080 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-e00996ec-8744-4392-9839-c3a785cf182d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:42.557849 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-e00996ec-8744-4392-9839-c3a785cf182d tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1577 microversion: 2.1 time: 0.178220 Jun 16 17:33:42.558561 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 494/988] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:42 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:33:43.577429 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-d1348e9a-6c0c-4d4a-a44b-5cc4412e4ecf tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:43.578069 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-d1348e9a-6c0c-4d4a-a44b-5cc4412e4ecf tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:43.585521 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d1348e9a-6c0c-4d4a-a44b-5cc4412e4ecf tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:43.585968 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d1348e9a-6c0c-4d4a-a44b-5cc4412e4ecf tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:43.587542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d1348e9a-6c0c-4d4a-a44b-5cc4412e4ecf tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:43.587985 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-d1348e9a-6c0c-4d4a-a44b-5cc4412e4ecf tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:43.662242 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-d1348e9a-6c0c-4d4a-a44b-5cc4412e4ecf tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbafeb56a4d4fd282275e4198ede783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1488226a424c6e9e7f94f31b020e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:33:43.670278 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-d1348e9a-6c0c-4d4a-a44b-5cc4412e4ecf tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 200 len: 1392 microversion: 2.1 time: 0.096804 Jun 16 17:33:43.670865 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 495/989] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:43 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 1392 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:33:43.694896 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-ce8fb332-34c5-41b2-9ba7-ff87c9117ba3 req-fdec30f2-6a66-4aa3-aaab-fe9dfe97a4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5b6345-48fe-44a0-b917-2b12902e234b", "name": "network-vif-deleted", "tag": "ccefb110-1f8f-47f6-a66f-5a8c5114a8dc"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:33:43.704095 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-ce8fb332-34c5-41b2-9ba7-ff87c9117ba3 req-fdec30f2-6a66-4aa3-aaab-fe9dfe97a4b7 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:43.704358 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-ce8fb332-34c5-41b2-9ba7-ff87c9117ba3 req-fdec30f2-6a66-4aa3-aaab-fe9dfe97a4b7 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:43.716169 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-ce8fb332-34c5-41b2-9ba7-ff87c9117ba3 req-fdec30f2-6a66-4aa3-aaab-fe9dfe97a4b7 service nova] Creating event network-vif-deleted:ccefb110-1f8f-47f6-a66f-5a8c5114a8dc for instance ce5b6345-48fe-44a0-b917-2b12902e234b on hv-cinder-83735 Jun 16 17:33:43.721389 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-ce8fb332-34c5-41b2-9ba7-ff87c9117ba3 req-fdec30f2-6a66-4aa3-aaab-fe9dfe97a4b7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030046 Jun 16 17:33:43.721988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 495/990] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:33:44.688828 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-98ca4d13-5eff-47f4-baaa-b743503c81d5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:44.689466 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-98ca4d13-5eff-47f4-baaa-b743503c81d5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: ce5b6345-48fe-44a0-b917-2b12902e234b] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:44.696430 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-98ca4d13-5eff-47f4-baaa-b743503c81d5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:44.696876 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-98ca4d13-5eff-47f4-baaa-b743503c81d5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:44.697704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-98ca4d13-5eff-47f4-baaa-b743503c81d5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:44.698281 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-98ca4d13-5eff-47f4-baaa-b743503c81d5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:44.715249 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-98ca4d13-5eff-47f4-baaa-b743503c81d5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] HTTP exception thrown: Instance ce5b6345-48fe-44a0-b917-2b12902e234b could not be found. Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-98ca4d13-5eff-47f4-baaa-b743503c81d5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Request method failure captured: Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b HTTP/1.1 Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2eFw6_U-ptmuweRKQwrW58d8B_3CgkZ165Jfz1FqCqwUodyV2kbBrfqufcZQUb2LLHllv0IvNEBSlfLrr31_0IlR8cbqRDs3hkA3KBNBR8SlLmCIRmf5gpJIYcsenQ27PlY5_NKbhJUEv4c_6cPSe4ryXG8zIcWdp6KYXNkC1rGups Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: bd1488226a424c6e9e7f94f31b020e4f Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-TestVolumeBootPattern-1350759327 Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:33:44.716937 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:33:44.719369 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bd1488226a424c6e9e7f94f31b020e4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bd1488226a424c6e9e7f94f31b020e4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bd1488226a424c6e9e7f94f31b020e4f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bd1488226a424c6e9e7f94f31b020e4f"}]}] Jun 16 17:33:44.719369 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-TestVolumeBootPattern-1350759327 Jun 16 17:33:44.719369 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: bd1488226a424c6e9e7f94f31b020e4f Jun 16 17:33:44.719369 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-TestVolumeBootPattern-1350759327 Jun 16 17:33:44.719369 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-TestVolumeBootPattern-1350759327-project Jun 16 17:33:44.719369 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:33:44.719369 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:33:44.719369 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: fbbafeb56a4d4fd282275e4198ede783 Jun 16 17:33:44.719369 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-TestVolumeBootPattern-1350759327-project Jun 16 17:33:44.719369 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:33:44.719369 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance ce5b6345-48fe-44a0-b917-2b12902e234b could not be found. Jun 16 17:33:44.719369 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': 'ce5b6345-48fe-44a0-b917-2b12902e234b'} Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce5b6345-48fe-44a0-b917-2b12902e234b could not be found. Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:33:44.720289 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce5b6345-48fe-44a0-b917-2b12902e234b could not be found. Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce5b6345-48fe-44a0-b917-2b12902e234b could not be found. Jun 16 17:33:44.722101 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:33:44.723431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-98ca4d13-5eff-47f4-baaa-b743503c81d5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Returning 404 to user: Instance ce5b6345-48fe-44a0-b917-2b12902e234b could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:33:44.723431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-98ca4d13-5eff-47f4-baaa-b743503c81d5 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b" status: 404 len: 111 microversion: 2.1 time: 0.034371 Jun 16 17:33:44.723431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 496/991] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:44 2022] GET /compute/v2.1/servers/ce5b6345-48fe-44a0-b917-2b12902e234b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:33:45.253531 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-bab3baeb-a1d7-48c9-a346-35eaa4750f19 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:45.254297 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-bab3baeb-a1d7-48c9-a346-35eaa4750f19 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:45.265961 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bab3baeb-a1d7-48c9-a346-35eaa4750f19 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:45.266414 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bab3baeb-a1d7-48c9-a346-35eaa4750f19 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:45.267206 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bab3baeb-a1d7-48c9-a346-35eaa4750f19 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:45.267711 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bab3baeb-a1d7-48c9-a346-35eaa4750f19 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:45.283744 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-bab3baeb-a1d7-48c9-a346-35eaa4750f19 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] HTTP exception thrown: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-bab3baeb-a1d7-48c9-a346-35eaa4750f19 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Request method failure captured: Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: DELETE /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 HTTP/1.1 Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2eFw6_U-ptmuweRKQwrW58d8B_3CgkZ165Jfz1FqCqwUodyV2kbBrfqufcZQUb2LLHllv0IvNEBSlfLrr31_0IlR8cbqRDs3hkA3KBNBR8SlLmCIRmf5gpJIYcsenQ27PlY5_NKbhJUEv4c_6cPSe4ryXG8zIcWdp6KYXNkC1rGups Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: bd1488226a424c6e9e7f94f31b020e4f Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-TestVolumeBootPattern-1350759327 Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:33:45.285503 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:33:45.287017 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bd1488226a424c6e9e7f94f31b020e4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bd1488226a424c6e9e7f94f31b020e4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bd1488226a424c6e9e7f94f31b020e4f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bd1488226a424c6e9e7f94f31b020e4f"}]}] Jun 16 17:33:45.287017 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-TestVolumeBootPattern-1350759327 Jun 16 17:33:45.287017 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: bd1488226a424c6e9e7f94f31b020e4f Jun 16 17:33:45.287017 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-TestVolumeBootPattern-1350759327 Jun 16 17:33:45.287017 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-TestVolumeBootPattern-1350759327-project Jun 16 17:33:45.287017 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:33:45.287017 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:33:45.287017 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: fbbafeb56a4d4fd282275e4198ede783 Jun 16 17:33:45.287017 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-TestVolumeBootPattern-1350759327-project Jun 16 17:33:45.287017 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:33:45.287017 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. Jun 16 17:33:45.287017 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': '157a0c77-c88e-4ef0-aef5-6ba851b57d00'} Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:33:45.288026 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. Jun 16 17:33:45.289547 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:33:45.294044 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-bab3baeb-a1d7-48c9-a346-35eaa4750f19 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Returning 404 to user: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:33:45.294044 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-bab3baeb-a1d7-48c9-a346-35eaa4750f19 tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "DELETE /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 404 len: 111 microversion: 2.1 time: 0.038914 Jun 16 17:33:45.294044 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 496/992] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:33:45 2022] DELETE /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:33:45.297332 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-aadcebb8-7bc3-4dbb-9f42-9a9ae3ac953e tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:45.298036 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-aadcebb8-7bc3-4dbb-9f42-9a9ae3ac953e tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] [instance: 157a0c77-c88e-4ef0-aef5-6ba851b57d00] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:45.304734 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-aadcebb8-7bc3-4dbb-9f42-9a9ae3ac953e tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:45.305193 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-aadcebb8-7bc3-4dbb-9f42-9a9ae3ac953e tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:45.306039 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-aadcebb8-7bc3-4dbb-9f42-9a9ae3ac953e tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:45.306452 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-aadcebb8-7bc3-4dbb-9f42-9a9ae3ac953e tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:45.325274 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-aadcebb8-7bc3-4dbb-9f42-9a9ae3ac953e tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] HTTP exception thrown: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-aadcebb8-7bc3-4dbb-9f42-9a9ae3ac953e tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Request method failure captured: Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 HTTP/1.1 Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2eFw6_U-ptmuweRKQwrW58d8B_3CgkZ165Jfz1FqCqwUodyV2kbBrfqufcZQUb2LLHllv0IvNEBSlfLrr31_0IlR8cbqRDs3hkA3KBNBR8SlLmCIRmf5gpJIYcsenQ27PlY5_NKbhJUEv4c_6cPSe4ryXG8zIcWdp6KYXNkC1rGups Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: bd1488226a424c6e9e7f94f31b020e4f Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-TestVolumeBootPattern-1350759327 Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:33:45.326818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:33:45.328779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bd1488226a424c6e9e7f94f31b020e4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bd1488226a424c6e9e7f94f31b020e4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bd1488226a424c6e9e7f94f31b020e4f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bd1488226a424c6e9e7f94f31b020e4f"}]}] Jun 16 17:33:45.328779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-TestVolumeBootPattern-1350759327 Jun 16 17:33:45.328779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: bd1488226a424c6e9e7f94f31b020e4f Jun 16 17:33:45.328779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-TestVolumeBootPattern-1350759327 Jun 16 17:33:45.328779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-TestVolumeBootPattern-1350759327-project Jun 16 17:33:45.328779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:33:45.328779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:33:45.328779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: fbbafeb56a4d4fd282275e4198ede783 Jun 16 17:33:45.328779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-TestVolumeBootPattern-1350759327-project Jun 16 17:33:45.328779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:33:45.328779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. Jun 16 17:33:45.328779 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': '157a0c77-c88e-4ef0-aef5-6ba851b57d00'} Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:33:45.329930 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. Jun 16 17:33:45.331484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:33:45.332885 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-aadcebb8-7bc3-4dbb-9f42-9a9ae3ac953e tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Returning 404 to user: Instance 157a0c77-c88e-4ef0-aef5-6ba851b57d00 could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:33:45.332885 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-aadcebb8-7bc3-4dbb-9f42-9a9ae3ac953e tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00" status: 404 len: 111 microversion: 2.1 time: 0.035082 Jun 16 17:33:45.332885 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 497/993] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:33:45 2022] GET /compute/v2.1/servers/157a0c77-c88e-4ef0-aef5-6ba851b57d00 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:33:46.711856 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-fd627ddc-2f63-4a8b-bbae-22d315f08cfd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] Calling method '.version_select at 0x7f66b1555310>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:46.735467 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-fd627ddc-2f63-4a8b-bbae-22d315f08cfd tempest-TestVolumeBootPattern-1350759327 tempest-TestVolumeBootPattern-1350759327-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2110136853" status: 202 len: 0 microversion: 2.1 time: 0.027467 Jun 16 17:33:46.736123 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 497/994] 10.222.0.66 () {58 vars in 1262 bytes} [Thu Jun 16 17:33:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2110136853 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:33:57.601048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5f1ae3f7-2a63-4c45-a3f5-2ad7c8b3d821 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:33:57.601800 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5f1ae3f7-2a63-4c45-a3f5-2ad7c8b3d821 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:57.604703 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:33:57.605534 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:33:57.613217 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5f1ae3f7-2a63-4c45-a3f5-2ad7c8b3d821 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:57.613667 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5f1ae3f7-2a63-4c45-a3f5-2ad7c8b3d821 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:57.614464 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5f1ae3f7-2a63-4c45-a3f5-2ad7c8b3d821 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:57.614886 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5f1ae3f7-2a63-4c45-a3f5-2ad7c8b3d821 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:57.641065 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5f1ae3f7-2a63-4c45-a3f5-2ad7c8b3d821 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68/ips" status: 200 len: 149 microversion: 2.1 time: 0.043740 Jun 16 17:33:57.641787 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 498/995] 10.222.0.66 () {58 vars in 1247 bytes} [Thu Jun 16 17:33:57 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:33:59.023396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-85d29b72-8427-47d0-8175-d0f42da2d342 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16291a2c-17df-4a8f-a54b-a6afd001205e"}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:33:59.024458 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-85d29b72-8427-47d0-8175-d0f42da2d342 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:33:59.030189 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:33:59.031479 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:33:59.040444 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-85d29b72-8427-47d0-8175-d0f42da2d342 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:59.040996 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-85d29b72-8427-47d0-8175-d0f42da2d342 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:59.041820 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-85d29b72-8427-47d0-8175-d0f42da2d342 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:59.042258 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-85d29b72-8427-47d0-8175-d0f42da2d342 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:59.334353 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-85d29b72-8427-47d0-8175-d0f42da2d342 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "POST /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312106 Jun 16 17:33:59.334353 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 498/996] 10.222.0.66 () {60 vars in 1322 bytes} [Thu Jun 16 17:33:59 2022] POST /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:06.897990 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-21081897-5dd2-4320-b8f3-990e254e74d8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16291a2c-17df-4a8f-a54b-a6afd001205e"}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:06.899355 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-21081897-5dd2-4320-b8f3-990e254e74d8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:06.908412 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-21081897-5dd2-4320-b8f3-990e254e74d8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:06.909066 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-21081897-5dd2-4320-b8f3-990e254e74d8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:06.910071 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-21081897-5dd2-4320-b8f3-990e254e74d8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:06.910637 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-21081897-5dd2-4320-b8f3-990e254e74d8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:07.004868 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-21081897-5dd2-4320-b8f3-990e254e74d8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] HTTP exception thrown: Invalid volume: volume 16291a2c-17df-4a8f-a54b-a6afd001205e is already attached to instances: db95418d-ea53-4a5b-b942-3809e3cfec68 Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-21081897-5dd2-4320-b8f3-990e254e74d8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Request method failure captured: Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: POST /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68/os-volume_attachments HTTP/1.1 Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 74 Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2jM6nxeVPJ_wLeywFOVtPZVOjk2Azcj0dSHnDAG1HXTfbt4n-fL381ERvSVeK072jADPqj1sD3G1uOZtdFTAW3_goCrw2fh09FT00PBj6Cln_7T21eu3gbi01NC1WoSQikUS_PWuftzY2MpE3UZ8fXZ0l8IvFGGpbesg0Z3ABVthA4 Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:34:07.006536 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:34:07.008266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7c56d4c430c44df49f48fe0b49ebcbd2", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7c56d4c430c44df49f48fe0b49ebcbd2"}]}] Jun 16 17:34:07.008266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:34:07.008266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:34:07.008266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:34:07.008266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:34:07.008266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:34:07.008266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:34:07.008266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: 642ef5f213254d818de4888cca274311 Jun 16 17:34:07.008266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:34:07.008266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Jun 16 17:34:07.008266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {"volumeAttachment": {"volumeId": "16291a2c-17df-4a8f-a54b-a6afd001205e"}} Jun 16 17:34:07.008266 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Invalid volume: volume 16291a2c-17df-4a8f-a54b-a6afd001205e is already attached to instances: db95418d-ea53-4a5b-b942-3809e3cfec68 Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'server_id': 'db95418d-ea53-4a5b-b942-3809e3cfec68', 'body': {'volumeAttachment': {'volumeId': '16291a2c-17df-4a8f-a54b-a6afd001205e'}}} Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 16291a2c-17df-4a8f-a54b-a6afd001205e is already attached to instances: db95418d-ea53-4a5b-b942-3809e3cfec68 Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:34:07.009233 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 16291a2c-17df-4a8f-a54b-a6afd001205e is already attached to instances: db95418d-ea53-4a5b-b942-3809e3cfec68 Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:34:07.010542 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:34:07.011893 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:34:07.011893 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:34:07.011893 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:34:07.011893 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 16291a2c-17df-4a8f-a54b-a6afd001205e is already attached to instances: db95418d-ea53-4a5b-b942-3809e3cfec68 Jun 16 17:34:07.011893 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:34:07.011893 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-21081897-5dd2-4320-b8f3-990e254e74d8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Returning 400 to user: Invalid volume: volume 16291a2c-17df-4a8f-a54b-a6afd001205e is already attached to instances: db95418d-ea53-4a5b-b942-3809e3cfec68 {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:34:07.011893 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-21081897-5dd2-4320-b8f3-990e254e74d8 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "POST /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115363 Jun 16 17:34:07.011893 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 499/997] 10.222.0.66 () {60 vars in 1322 bytes} [Thu Jun 16 17:34:06 2022] POST /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:34:07.073257 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f926d059-d9f1-4d31-bdd8-0aabfd317c3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:07.073929 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f926d059-d9f1-4d31-bdd8-0aabfd317c3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:07.080603 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f926d059-d9f1-4d31-bdd8-0aabfd317c3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:07.081058 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f926d059-d9f1-4d31-bdd8-0aabfd317c3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:07.081857 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f926d059-d9f1-4d31-bdd8-0aabfd317c3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:07.082288 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f926d059-d9f1-4d31-bdd8-0aabfd317c3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:07.172987 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.objects.instance [None req-f926d059-d9f1-4d31-bdd8-0aabfd317c3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lazy-loading 'services' on Instance uuid db95418d-ea53-4a5b-b942-3809e3cfec68 {{(pid=117552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:34:07.250240 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f926d059-d9f1-4d31-bdd8-0aabfd317c3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "DELETE /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68/os-volume_attachments/16291a2c-17df-4a8f-a54b-a6afd001205e" status: 202 len: 0 microversion: 2.1 time: 0.182254 Jun 16 17:34:07.250790 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 499/998] 10.222.0.66 () {58 vars in 1415 bytes} [Thu Jun 16 17:34:07 2022] DELETE /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68/os-volume_attachments/16291a2c-17df-4a8f-a54b-a6afd001205e => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:34:07.260006 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-5ce06081-b3d4-4a78-8407-1c4d9d4c84e0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:07.260964 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-5ce06081-b3d4-4a78-8407-1c4d9d4c84e0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:07.267600 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5ce06081-b3d4-4a78-8407-1c4d9d4c84e0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:07.268048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5ce06081-b3d4-4a78-8407-1c4d9d4c84e0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:07.269137 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5ce06081-b3d4-4a78-8407-1c4d9d4c84e0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:07.269669 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-5ce06081-b3d4-4a78-8407-1c4d9d4c84e0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:07.306704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-5ce06081-b3d4-4a78-8407-1c4d9d4c84e0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051276 Jun 16 17:34:07.307204 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 500/999] 10.222.0.66 () {58 vars in 1301 bytes} [Thu Jun 16 17:34:07 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:08.319589 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-bb68764c-184b-4dd8-b3b3-11e3d23589b0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:08.320697 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-bb68764c-184b-4dd8-b3b3-11e3d23589b0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:08.328398 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bb68764c-184b-4dd8-b3b3-11e3d23589b0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:08.328936 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bb68764c-184b-4dd8-b3b3-11e3d23589b0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:08.329734 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bb68764c-184b-4dd8-b3b3-11e3d23589b0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:08.330188 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bb68764c-184b-4dd8-b3b3-11e3d23589b0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:08.363768 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-bb68764c-184b-4dd8-b3b3-11e3d23589b0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048664 Jun 16 17:34:08.364337 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 500/1000] 10.222.0.66 () {58 vars in 1301 bytes} [Thu Jun 16 17:34:08 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:34:08.432168 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-838d3547-1da9-409e-b631-d14f7acc0510 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:08.432803 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-838d3547-1da9-409e-b631-d14f7acc0510 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:08.440097 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-838d3547-1da9-409e-b631-d14f7acc0510 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:08.440544 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-838d3547-1da9-409e-b631-d14f7acc0510 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:08.441359 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-838d3547-1da9-409e-b631-d14f7acc0510 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:08.441786 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-838d3547-1da9-409e-b631-d14f7acc0510 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:08.469278 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-838d3547-1da9-409e-b631-d14f7acc0510 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Going to try to terminate instance {{(pid=117553) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:34:08.566078 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-838d3547-1da9-409e-b631-d14f7acc0510 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "DELETE /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68" status: 204 len: 0 microversion: 2.1 time: 0.137296 Jun 16 17:34:08.566873 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 501/1001] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:34:08 2022] DELETE /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:34:08.576528 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-30ba3df9-41a7-4d99-af7e-69ba6492307c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:08.577431 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-30ba3df9-41a7-4d99-af7e-69ba6492307c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:08.585575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-30ba3df9-41a7-4d99-af7e-69ba6492307c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:08.586168 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-30ba3df9-41a7-4d99-af7e-69ba6492307c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:08.587168 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-30ba3df9-41a7-4d99-af7e-69ba6492307c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:08.587707 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-30ba3df9-41a7-4d99-af7e-69ba6492307c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:08.741245 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-30ba3df9-41a7-4d99-af7e-69ba6492307c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:08.752163 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-30ba3df9-41a7-4d99-af7e-69ba6492307c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68" status: 200 len: 1680 microversion: 2.1 time: 0.180589 Jun 16 17:34:08.752995 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 501/1002] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:08 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:34:09.771310 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4a9992b5-6f33-4b71-b224-8d290ac5b37f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:09.772039 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4a9992b5-6f33-4b71-b224-8d290ac5b37f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:09.778992 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4a9992b5-6f33-4b71-b224-8d290ac5b37f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:09.779438 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4a9992b5-6f33-4b71-b224-8d290ac5b37f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:09.780240 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4a9992b5-6f33-4b71-b224-8d290ac5b37f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:09.780940 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4a9992b5-6f33-4b71-b224-8d290ac5b37f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:09.944519 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4a9992b5-6f33-4b71-b224-8d290ac5b37f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:09.952671 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4a9992b5-6f33-4b71-b224-8d290ac5b37f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68" status: 200 len: 1680 microversion: 2.1 time: 0.185646 Jun 16 17:34:09.953687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 502/1003] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:09 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:34:10.976683 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-35c2f141-fcbe-4fbc-beda-0da16b3dbf4d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:10.977728 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-35c2f141-fcbe-4fbc-beda-0da16b3dbf4d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:10.984881 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-35c2f141-fcbe-4fbc-beda-0da16b3dbf4d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:10.985382 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-35c2f141-fcbe-4fbc-beda-0da16b3dbf4d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:10.986151 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-35c2f141-fcbe-4fbc-beda-0da16b3dbf4d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:10.986574 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-35c2f141-fcbe-4fbc-beda-0da16b3dbf4d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:11.066932 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-35c2f141-fcbe-4fbc-beda-0da16b3dbf4d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:11.075006 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-35c2f141-fcbe-4fbc-beda-0da16b3dbf4d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68" status: 200 len: 1613 microversion: 2.1 time: 0.103439 Jun 16 17:34:11.076068 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 502/1004] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:10 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 => generated 1613 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:11.400088 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-303a2e2c-fc5a-4826-9a88-39e69c53d188 req-6c14579e-6a02-4444-ac73-49098fb907cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db95418d-ea53-4a5b-b942-3809e3cfec68", "name": "network-vif-deleted", "tag": "4d5b77eb-61af-4c99-a4e0-4afb006eb6b8"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:11.410503 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-303a2e2c-fc5a-4826-9a88-39e69c53d188 req-6c14579e-6a02-4444-ac73-49098fb907cb service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:11.410503 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-303a2e2c-fc5a-4826-9a88-39e69c53d188 req-6c14579e-6a02-4444-ac73-49098fb907cb service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:11.424117 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-303a2e2c-fc5a-4826-9a88-39e69c53d188 req-6c14579e-6a02-4444-ac73-49098fb907cb service nova] Creating event network-vif-deleted:4d5b77eb-61af-4c99-a4e0-4afb006eb6b8 for instance db95418d-ea53-4a5b-b942-3809e3cfec68 on hv-cinder-83735 Jun 16 17:34:11.429590 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-303a2e2c-fc5a-4826-9a88-39e69c53d188 req-6c14579e-6a02-4444-ac73-49098fb907cb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033240 Jun 16 17:34:11.430479 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 503/1005] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:34:12.092192 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-6ebc768b-1105-4ff5-8cc5-4ef0871c0e2d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:12.092897 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-6ebc768b-1105-4ff5-8cc5-4ef0871c0e2d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:12.101825 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6ebc768b-1105-4ff5-8cc5-4ef0871c0e2d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:12.102183 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6ebc768b-1105-4ff5-8cc5-4ef0871c0e2d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:12.102970 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6ebc768b-1105-4ff5-8cc5-4ef0871c0e2d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:12.103397 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-6ebc768b-1105-4ff5-8cc5-4ef0871c0e2d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:12.118897 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-6ebc768b-1105-4ff5-8cc5-4ef0871c0e2d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] HTTP exception thrown: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-6ebc768b-1105-4ff5-8cc5-4ef0871c0e2d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Request method failure captured: Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 HTTP/1.1 Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2jM6nxeVPJ_wLeywFOVtPZVOjk2Azcj0dSHnDAG1HXTfbt4n-fL381ERvSVeK072jADPqj1sD3G1uOZtdFTAW3_goCrw2fh09FT00PBj6Cln_7T21eu3gbi01NC1WoSQikUS_PWuftzY2MpE3UZ8fXZ0l8IvFGGpbesg0Z3ABVthA4 Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:34:12.120761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:34:12.123012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7c56d4c430c44df49f48fe0b49ebcbd2", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7c56d4c430c44df49f48fe0b49ebcbd2"}]}] Jun 16 17:34:12.123012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:34:12.123012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:34:12.123012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:34:12.123012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:34:12.123012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:34:12.123012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:34:12.123012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 642ef5f213254d818de4888cca274311 Jun 16 17:34:12.123012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:34:12.123012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:34:12.123012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. Jun 16 17:34:12.123012 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': 'db95418d-ea53-4a5b-b942-3809e3cfec68'} Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:34:12.124100 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. Jun 16 17:34:12.125979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:34:12.127615 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-6ebc768b-1105-4ff5-8cc5-4ef0871c0e2d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Returning 404 to user: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:34:12.127615 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-6ebc768b-1105-4ff5-8cc5-4ef0871c0e2d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68" status: 404 len: 111 microversion: 2.1 time: 0.034726 Jun 16 17:34:12.127615 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 503/1006] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:12 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:34:12.134065 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-1559d4ed-3a98-4c4f-9696-84360c327f1e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '.version_select at 0x7f66b15b0310>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:12.157388 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-1559d4ed-3a98-4c4f-9696-84360c327f1e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-877487804" status: 202 len: 0 microversion: 2.1 time: 0.027766 Jun 16 17:34:12.158082 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 504/1007] 10.222.0.66 () {58 vars in 1217 bytes} [Thu Jun 16 17:34:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-877487804 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:34:13.118048 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-76920d09-97e9-4390-a9c2-14620c4d311b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Action: 'create', calling method: .version_select at 0x7f66b1bcb700>, body: {"keypair": {"name": "tempest-keypair-1886661746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFEc22BwduUgvinQ1JV4WZBfARSE+Yk1vMdAdcCWRviXc4GlYbhT2El+XGjknHnoH9L0VFW9O5iB1P12QN9QlilfTUKjSkQt6zwMuPzlehP8OUEraX8/nhmakQ0qr0NzQ=="}} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:13.142860 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-76920d09-97e9-4390-a9c2-14620c4d311b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Getting quotas for project 7c56d4c430c44df49f48fe0b49ebcbd2. Resources: {'key_pairs'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:34:13.147706 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.quota [None req-76920d09-97e9-4390-a9c2-14620c4d311b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Getting quotas for user 642ef5f213254d818de4888cca274311 and project 7c56d4c430c44df49f48fe0b49ebcbd2. Resources: {'key_pairs'} {{(pid=117552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:34:13.172776 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-76920d09-97e9-4390-a9c2-14620c4d311b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058610 Jun 16 17:34:13.173476 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 504/1008] 10.222.0.66 () {60 vars in 1158 bytes} [Thu Jun 16 17:34:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:14.618015 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-f2b61f10-2fdd-4312-af8d-cf8fd56df858 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2029058495", "imageRef": "c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38b62bc9-5cad-4b9e-8181-628535658100"}], "security_groups": [{"name": "tempest-securitygroup--1129762449"}], "key_name": "tempest-keypair-1886661746", "user_data": "}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:14.729390 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.network.neutron [None req-f2b61f10-2fdd-4312-af8d-cf8fd56df858 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] validate_networks() for [('38b62bc9-5cad-4b9e-8181-628535658100', None, None, None, None, None)] {{(pid=117553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:34:15.136240 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-f2b61f10-2fdd-4312-af8d-cf8fd56df858 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Flavor limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:34:15.136662 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-f2b61f10-2fdd-4312-af8d-cf8fd56df858 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Image limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:34:15.137125 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-f2b61f10-2fdd-4312-af8d-cf8fd56df858 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Flavor pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:34:15.137555 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-f2b61f10-2fdd-4312-af8d-cf8fd56df858 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Image pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:34:15.137967 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-f2b61f10-2fdd-4312-af8d-cf8fd56df858 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:34:15.147166 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f2b61f10-2fdd-4312-af8d-cf8fd56df858 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:15.147603 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f2b61f10-2fdd-4312-af8d-cf8fd56df858 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:15.148373 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f2b61f10-2fdd-4312-af8d-cf8fd56df858 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:15.148837 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-f2b61f10-2fdd-4312-af8d-cf8fd56df858 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:15.167199 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-f2b61f10-2fdd-4312-af8d-cf8fd56df858 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Getting quotas for project 7c56d4c430c44df49f48fe0b49ebcbd2. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:34:15.172015 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-f2b61f10-2fdd-4312-af8d-cf8fd56df858 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Getting quotas for user 642ef5f213254d818de4888cca274311 and project 7c56d4c430c44df49f48fe0b49ebcbd2. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:34:15.185217 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f2b61f10-2fdd-4312-af8d-cf8fd56df858 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Going to run 1 instances... {{(pid=117553) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:34:15.187719 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-f2b61f10-2fdd-4312-af8d-cf8fd56df858 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:34:15.241689 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-f2b61f10-2fdd-4312-af8d-cf8fd56df858 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.628513 Jun 16 17:34:15.242340 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 505/1009] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:34:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:34:15.254833 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-83bb27ba-df88-4f77-a941-ffa3ab649651 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:15.255458 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-83bb27ba-df88-4f77-a941-ffa3ab649651 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:15.312318 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-83bb27ba-df88-4f77-a941-ffa3ab649651 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:15.320540 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-83bb27ba-df88-4f77-a941-ffa3ab649651 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 200 len: 1242 microversion: 2.1 time: 0.072041 Jun 16 17:34:15.321088 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 505/1010] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:15 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:16.338778 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-60a19c01-fe08-4db2-ba2b-ae134a47b146 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:16.340349 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-60a19c01-fe08-4db2-ba2b-ae134a47b146 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:16.365763 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-60a19c01-fe08-4db2-ba2b-ae134a47b146 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:16.366390 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-60a19c01-fe08-4db2-ba2b-ae134a47b146 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:16.367286 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-60a19c01-fe08-4db2-ba2b-ae134a47b146 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:16.367815 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-60a19c01-fe08-4db2-ba2b-ae134a47b146 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:16.463155 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-60a19c01-fe08-4db2-ba2b-ae134a47b146 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:16.481897 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-60a19c01-fe08-4db2-ba2b-ae134a47b146 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 200 len: 1312 microversion: 2.1 time: 0.146881 Jun 16 17:34:16.482708 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 506/1011] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:16 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 1312 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:17.335179 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-bc5a2dcb-6951-443d-83ca-574340c4caa8 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:17.335179 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-bc5a2dcb-6951-443d-83ca-574340c4caa8 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:17.336081 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-b09ccd69-8ec9-49ec-aeac-a363a5545759 req-702d9683-bf68-4286-8095-866a6b3ff52e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc6f984-945e-4244-b25d-45c9022782dd", "tag": "9ab6739f-6b37-443b-9a2c-8dc7f323433a"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:17.346121 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-b09ccd69-8ec9-49ec-aeac-a363a5545759 req-702d9683-bf68-4286-8095-866a6b3ff52e service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:17.347501 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-b09ccd69-8ec9-49ec-aeac-a363a5545759 req-702d9683-bf68-4286-8095-866a6b3ff52e service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:17.351061 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bc5a2dcb-6951-443d-83ca-574340c4caa8 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:17.351509 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bc5a2dcb-6951-443d-83ca-574340c4caa8 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:17.352306 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bc5a2dcb-6951-443d-83ca-574340c4caa8 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:17.352737 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-bc5a2dcb-6951-443d-83ca-574340c4caa8 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:17.363540 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-b09ccd69-8ec9-49ec-aeac-a363a5545759 req-702d9683-bf68-4286-8095-866a6b3ff52e service nova] Creating event network-changed:9ab6739f-6b37-443b-9a2c-8dc7f323433a for instance 1cc6f984-945e-4244-b25d-45c9022782dd on hv-cinder-83735 Jun 16 17:34:17.368855 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-b09ccd69-8ec9-49ec-aeac-a363a5545759 req-702d9683-bf68-4286-8095-866a6b3ff52e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039683 Jun 16 17:34:17.369642 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 507/1012] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:17.398622 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-bc5a2dcb-6951-443d-83ca-574340c4caa8 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Going to try to terminate instance {{(pid=117552) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:34:17.504836 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-0ddd52b2-75e9-46e4-91ab-4b034bf7dc02 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:17.506027 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-0ddd52b2-75e9-46e4-91ab-4b034bf7dc02 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:17.516057 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0ddd52b2-75e9-46e4-91ab-4b034bf7dc02 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:17.517554 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0ddd52b2-75e9-46e4-91ab-4b034bf7dc02 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:17.519741 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0ddd52b2-75e9-46e4-91ab-4b034bf7dc02 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:17.522111 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0ddd52b2-75e9-46e4-91ab-4b034bf7dc02 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:17.550996 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-bc5a2dcb-6951-443d-83ca-574340c4caa8 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 204 len: 0 microversion: 2.1 time: 0.226536 Jun 16 17:34:17.552569 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 506/1013] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:34:17 2022] DELETE /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:34:17.566088 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5e4964cc-5901-492d-93d6-437f9ac9efaa tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:17.567085 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-5e4964cc-5901-492d-93d6-437f9ac9efaa tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:17.574166 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5e4964cc-5901-492d-93d6-437f9ac9efaa tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:17.575027 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5e4964cc-5901-492d-93d6-437f9ac9efaa tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:17.575798 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5e4964cc-5901-492d-93d6-437f9ac9efaa tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:17.576337 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5e4964cc-5901-492d-93d6-437f9ac9efaa tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:17.721397 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0ddd52b2-75e9-46e4-91ab-4b034bf7dc02 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:17.731681 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-0ddd52b2-75e9-46e4-91ab-4b034bf7dc02 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 200 len: 1368 microversion: 2.1 time: 0.233983 Jun 16 17:34:17.732844 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 508/1014] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:17 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:18.134340 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5e4964cc-5901-492d-93d6-437f9ac9efaa tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:18.143557 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-5e4964cc-5901-492d-93d6-437f9ac9efaa tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1568 microversion: 2.1 time: 0.584927 Jun 16 17:34:18.144604 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 507/1015] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:17 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1568 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:18.485082 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-664f6c85-ae2b-4aca-9b6f-ffae6c16ff2c req-482a503d-2f1c-406c-ba2c-39d394cb4b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a361a3b2-1d56-4cd9-9fb3-87d37147881f", "tag": "778f57a0-7cf0-4efe-9b55-04da77cb372e"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:18.502434 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-664f6c85-ae2b-4aca-9b6f-ffae6c16ff2c req-482a503d-2f1c-406c-ba2c-39d394cb4b77 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:18.503180 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-664f6c85-ae2b-4aca-9b6f-ffae6c16ff2c req-482a503d-2f1c-406c-ba2c-39d394cb4b77 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:18.522213 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-664f6c85-ae2b-4aca-9b6f-ffae6c16ff2c req-482a503d-2f1c-406c-ba2c-39d394cb4b77 service nova] Creating event network-changed:778f57a0-7cf0-4efe-9b55-04da77cb372e for instance a361a3b2-1d56-4cd9-9fb3-87d37147881f on hv-cinder-83735 Jun 16 17:34:18.527752 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-664f6c85-ae2b-4aca-9b6f-ffae6c16ff2c req-482a503d-2f1c-406c-ba2c-39d394cb4b77 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046384 Jun 16 17:34:18.528710 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 509/1016] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:18.754076 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7dc09b4b-12fa-4a35-aaac-669942adcd3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:18.754885 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7dc09b4b-12fa-4a35-aaac-669942adcd3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:18.762263 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7dc09b4b-12fa-4a35-aaac-669942adcd3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:18.762851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7dc09b4b-12fa-4a35-aaac-669942adcd3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:18.764573 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7dc09b4b-12fa-4a35-aaac-669942adcd3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:18.766602 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7dc09b4b-12fa-4a35-aaac-669942adcd3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:19.034243 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-7dc09b4b-12fa-4a35-aaac-669942adcd3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:19.043451 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7dc09b4b-12fa-4a35-aaac-669942adcd3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 200 len: 1368 microversion: 2.1 time: 0.295996 Jun 16 17:34:19.052787 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 508/1017] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:18 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 1368 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:19.162952 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-57256301-f71d-4025-9992-b4625d8aa102 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:19.163833 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-57256301-f71d-4025-9992-b4625d8aa102 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:19.173295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-57256301-f71d-4025-9992-b4625d8aa102 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:19.174544 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-57256301-f71d-4025-9992-b4625d8aa102 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:19.175618 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-57256301-f71d-4025-9992-b4625d8aa102 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:19.176272 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-57256301-f71d-4025-9992-b4625d8aa102 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:19.421274 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-57256301-f71d-4025-9992-b4625d8aa102 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:19.430210 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-57256301-f71d-4025-9992-b4625d8aa102 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1568 microversion: 2.1 time: 0.270967 Jun 16 17:34:19.438687 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 510/1018] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:19 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1568 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:34:19.668405 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-6cf31bfc-2717-446b-915e-289790d6e387 req-ac4d5de9-98b5-40a3-b05c-443cc8586b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc6f984-945e-4244-b25d-45c9022782dd", "name": "network-vif-deleted", "tag": "9ab6739f-6b37-443b-9a2c-8dc7f323433a"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:19.677897 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-6cf31bfc-2717-446b-915e-289790d6e387 req-ac4d5de9-98b5-40a3-b05c-443cc8586b2c service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:19.678373 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-6cf31bfc-2717-446b-915e-289790d6e387 req-ac4d5de9-98b5-40a3-b05c-443cc8586b2c service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:19.692203 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-6cf31bfc-2717-446b-915e-289790d6e387 req-ac4d5de9-98b5-40a3-b05c-443cc8586b2c service nova] Creating event network-vif-deleted:9ab6739f-6b37-443b-9a2c-8dc7f323433a for instance 1cc6f984-945e-4244-b25d-45c9022782dd on hv-cinder-83735 Jun 16 17:34:19.697301 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-6cf31bfc-2717-446b-915e-289790d6e387 req-ac4d5de9-98b5-40a3-b05c-443cc8586b2c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032805 Jun 16 17:34:19.697890 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 509/1019] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:20.060254 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-02d9f304-4ad2-40c4-a86e-083f8f5c896f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:20.061960 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-02d9f304-4ad2-40c4-a86e-083f8f5c896f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:20.072616 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-02d9f304-4ad2-40c4-a86e-083f8f5c896f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:20.073165 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-02d9f304-4ad2-40c4-a86e-083f8f5c896f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:20.074051 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-02d9f304-4ad2-40c4-a86e-083f8f5c896f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:20.076052 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-02d9f304-4ad2-40c4-a86e-083f8f5c896f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:20.216213 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-02d9f304-4ad2-40c4-a86e-083f8f5c896f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:20.224247 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-02d9f304-4ad2-40c4-a86e-083f8f5c896f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 200 len: 1368 microversion: 2.1 time: 0.167902 Jun 16 17:34:20.224840 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 511/1020] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:20 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:20.447721 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b708142d-f350-4bcf-b690-766c0f63ecf1 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:20.448561 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b708142d-f350-4bcf-b690-766c0f63ecf1 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:20.456127 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b708142d-f350-4bcf-b690-766c0f63ecf1 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:20.456678 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b708142d-f350-4bcf-b690-766c0f63ecf1 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:20.457627 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b708142d-f350-4bcf-b690-766c0f63ecf1 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:20.458219 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b708142d-f350-4bcf-b690-766c0f63ecf1 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:20.540572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-b708142d-f350-4bcf-b690-766c0f63ecf1 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd1d0ce941845c3a28e2cd5fc77c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aeadccaa9348fd9af173f94291bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:20.564193 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b708142d-f350-4bcf-b690-766c0f63ecf1 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 200 len: 1219 microversion: 2.1 time: 0.121224 Jun 16 17:34:20.574152 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 510/1021] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:20 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:21.242075 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4f660edf-4926-4928-8042-c35219bdc826 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:21.242665 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4f660edf-4926-4928-8042-c35219bdc826 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:21.249877 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4f660edf-4926-4928-8042-c35219bdc826 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:21.250310 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4f660edf-4926-4928-8042-c35219bdc826 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:21.251093 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4f660edf-4926-4928-8042-c35219bdc826 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:21.251552 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4f660edf-4926-4928-8042-c35219bdc826 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:21.405255 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-4f660edf-4926-4928-8042-c35219bdc826 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:21.412971 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4f660edf-4926-4928-8042-c35219bdc826 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 200 len: 1368 microversion: 2.1 time: 0.174813 Jun 16 17:34:21.413579 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 512/1022] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:21 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:21.583171 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-912818fb-b228-4ff6-b0be-aa3130f2cb66 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:21.583788 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-912818fb-b228-4ff6-b0be-aa3130f2cb66 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] [instance: 1cc6f984-945e-4244-b25d-45c9022782dd] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:21.593544 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-912818fb-b228-4ff6-b0be-aa3130f2cb66 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:21.594121 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-912818fb-b228-4ff6-b0be-aa3130f2cb66 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:21.594907 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-912818fb-b228-4ff6-b0be-aa3130f2cb66 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:21.595342 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-912818fb-b228-4ff6-b0be-aa3130f2cb66 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:21.628184 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-912818fb-b228-4ff6-b0be-aa3130f2cb66 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] HTTP exception thrown: Instance 1cc6f984-945e-4244-b25d-45c9022782dd could not be found. Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-912818fb-b228-4ff6-b0be-aa3130f2cb66 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Request method failure captured: Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd HTTP/1.1 Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2iBHxx9KGdM-vmAiOzViSJyQLozFK1LSopBDo_-9P6YK20lXkAMqib2T4VTHIvbpNw_k9m9Ud9UcLMv3pMw7Acbqm3uMmi96GpnxFKAIsnMGuLxdfvH8HsIAWF4mzHRgBL30zMBsgxVVFxJT0RnE7euX9czJyIswlx7Ip29TyXVoIc Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 50aeadccaa9348fd9af173f94291bf6f Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-TestShelveInstance-792984814 Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:34:21.629886 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:34:21.631325 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/50aeadccaa9348fd9af173f94291bf6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/50aeadccaa9348fd9af173f94291bf6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_50aeadccaa9348fd9af173f94291bf6f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/50aeadccaa9348fd9af173f94291bf6f"}]}] Jun 16 17:34:21.631325 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-TestShelveInstance-792984814 Jun 16 17:34:21.631325 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 50aeadccaa9348fd9af173f94291bf6f Jun 16 17:34:21.631325 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-TestShelveInstance-792984814 Jun 16 17:34:21.631325 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-TestShelveInstance-792984814-project Jun 16 17:34:21.631325 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:34:21.631325 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:34:21.631325 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 6cd1d0ce941845c3a28e2cd5fc77c844 Jun 16 17:34:21.631325 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-TestShelveInstance-792984814-project Jun 16 17:34:21.631325 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:34:21.631325 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance 1cc6f984-945e-4244-b25d-45c9022782dd could not be found. Jun 16 17:34:21.631325 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': '1cc6f984-945e-4244-b25d-45c9022782dd'} Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc6f984-945e-4244-b25d-45c9022782dd could not be found. Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:34:21.635578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc6f984-945e-4244-b25d-45c9022782dd could not be found. Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc6f984-945e-4244-b25d-45c9022782dd could not be found. Jun 16 17:34:21.637092 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:34:21.639664 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-912818fb-b228-4ff6-b0be-aa3130f2cb66 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Returning 404 to user: Instance 1cc6f984-945e-4244-b25d-45c9022782dd could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:34:21.639664 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-912818fb-b228-4ff6-b0be-aa3130f2cb66 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd" status: 404 len: 111 microversion: 2.1 time: 0.052525 Jun 16 17:34:21.639664 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 511/1023] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:21 2022] GET /compute/v2.1/servers/1cc6f984-945e-4244-b25d-45c9022782dd => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:34:21.825227 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-26c3aaf2-2f15-4641-bad8-af72a54e40e7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] Calling method '.version_select at 0x7f66b16fe310>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:21.854686 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-26c3aaf2-2f15-4641-bad8-af72a54e40e7 tempest-TestShelveInstance-792984814 tempest-TestShelveInstance-792984814-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-632486400" status: 202 len: 0 microversion: 2.1 time: 0.033714 Jun 16 17:34:21.855443 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 513/1024] 10.222.0.66 () {58 vars in 1250 bytes} [Thu Jun 16 17:34:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-632486400 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:34:22.429759 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5eab8530-64a2-4b1e-8422-2acc8540282c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:22.430470 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-5eab8530-64a2-4b1e-8422-2acc8540282c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:22.436964 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5eab8530-64a2-4b1e-8422-2acc8540282c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:22.437426 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5eab8530-64a2-4b1e-8422-2acc8540282c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:22.438229 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5eab8530-64a2-4b1e-8422-2acc8540282c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:22.438666 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5eab8530-64a2-4b1e-8422-2acc8540282c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:22.673988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5eab8530-64a2-4b1e-8422-2acc8540282c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:22.689055 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-5eab8530-64a2-4b1e-8422-2acc8540282c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 200 len: 1368 microversion: 2.1 time: 0.262765 Jun 16 17:34:22.690582 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 512/1025] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:22 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:23.713973 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2f46df85-6ab2-46c9-bb3e-deda869f83a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:23.715541 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2f46df85-6ab2-46c9-bb3e-deda869f83a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:23.723386 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2f46df85-6ab2-46c9-bb3e-deda869f83a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:23.724140 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2f46df85-6ab2-46c9-bb3e-deda869f83a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:23.725442 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2f46df85-6ab2-46c9-bb3e-deda869f83a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:23.725863 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2f46df85-6ab2-46c9-bb3e-deda869f83a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:23.883403 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-2f46df85-6ab2-46c9-bb3e-deda869f83a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:23.892618 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2f46df85-6ab2-46c9-bb3e-deda869f83a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 200 len: 1368 microversion: 2.1 time: 0.183154 Jun 16 17:34:23.894395 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 514/1026] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:23 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:24.915282 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-946cd177-718e-4472-9cc9-c9b3aa59476a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:24.916738 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-946cd177-718e-4472-9cc9-c9b3aa59476a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:24.935389 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-946cd177-718e-4472-9cc9-c9b3aa59476a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:24.936115 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-946cd177-718e-4472-9cc9-c9b3aa59476a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:24.937554 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-946cd177-718e-4472-9cc9-c9b3aa59476a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:24.938203 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-946cd177-718e-4472-9cc9-c9b3aa59476a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:25.059570 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-0cc398de-ae4c-496d-995c-9e092c2326b9 req-c28dc102-f918-42de-8866-a7fbb4d323cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a361a3b2-1d56-4cd9-9fb3-87d37147881f", "name": "network-vif-plugged", "status": "completed", "tag": "778f57a0-7cf0-4efe-9b55-04da77cb372e"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:25.070534 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-0cc398de-ae4c-496d-995c-9e092c2326b9 req-c28dc102-f918-42de-8866-a7fbb4d323cc service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:25.070980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-0cc398de-ae4c-496d-995c-9e092c2326b9 req-c28dc102-f918-42de-8866-a7fbb4d323cc service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:25.098419 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-0cc398de-ae4c-496d-995c-9e092c2326b9 req-c28dc102-f918-42de-8866-a7fbb4d323cc service nova] Creating event network-vif-plugged:778f57a0-7cf0-4efe-9b55-04da77cb372e for instance a361a3b2-1d56-4cd9-9fb3-87d37147881f on hv-cinder-83735 Jun 16 17:34:25.110635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-0cc398de-ae4c-496d-995c-9e092c2326b9 req-c28dc102-f918-42de-8866-a7fbb4d323cc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275266 Jun 16 17:34:25.112156 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 513/1027] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:25.122564 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-946cd177-718e-4472-9cc9-c9b3aa59476a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:25.132296 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-946cd177-718e-4472-9cc9-c9b3aa59476a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 200 len: 1368 microversion: 2.1 time: 0.222957 Jun 16 17:34:25.133194 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 515/1028] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:24 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:26.148372 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=6 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:26.153238 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-369dba3b-f07c-4bc9-b16b-87d4b0e1c506 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:26.153950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-369dba3b-f07c-4bc9-b16b-87d4b0e1c506 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:26.160828 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-369dba3b-f07c-4bc9-b16b-87d4b0e1c506 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:26.161346 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-369dba3b-f07c-4bc9-b16b-87d4b0e1c506 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:26.162102 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-369dba3b-f07c-4bc9-b16b-87d4b0e1c506 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:26.162754 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-369dba3b-f07c-4bc9-b16b-87d4b0e1c506 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:26.392514 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-369dba3b-f07c-4bc9-b16b-87d4b0e1c506 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:26.400333 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-369dba3b-f07c-4bc9-b16b-87d4b0e1c506 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 200 len: 1368 microversion: 2.1 time: 0.252919 Jun 16 17:34:26.400909 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 514/1029] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:26 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:27.417586 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a627a5f8-5daf-4dac-9a19-8e6a54612b4d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:27.418517 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a627a5f8-5daf-4dac-9a19-8e6a54612b4d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:27.420574 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:27.422337 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=6 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:27.428736 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a627a5f8-5daf-4dac-9a19-8e6a54612b4d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:27.429218 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a627a5f8-5daf-4dac-9a19-8e6a54612b4d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:27.430027 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a627a5f8-5daf-4dac-9a19-8e6a54612b4d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:27.430461 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a627a5f8-5daf-4dac-9a19-8e6a54612b4d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:27.592944 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a627a5f8-5daf-4dac-9a19-8e6a54612b4d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:27.602728 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a627a5f8-5daf-4dac-9a19-8e6a54612b4d tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 200 len: 1557 microversion: 2.1 time: 0.187444 Jun 16 17:34:27.602728 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 516/1030] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:27 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 1557 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:27.621023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0861be52-db65-4cc2-a1a3-a15ab490fa30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:27.621679 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0861be52-db65-4cc2-a1a3-a15ab490fa30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:27.628990 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0861be52-db65-4cc2-a1a3-a15ab490fa30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:27.629880 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0861be52-db65-4cc2-a1a3-a15ab490fa30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:27.631187 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0861be52-db65-4cc2-a1a3-a15ab490fa30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:27.631736 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0861be52-db65-4cc2-a1a3-a15ab490fa30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:27.662498 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:27.774590 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0861be52-db65-4cc2-a1a3-a15ab490fa30 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159822 Jun 16 17:34:27.775244 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 515/1031] 10.222.0.66 () {58 vars in 1274 bytes} [Thu Jun 16 17:34:27 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:29.206434 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-a416af94-78d0-404c-b748-5d220a092249 req-4be4c8fb-05af-4d77-890b-b9ca332e3a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a361a3b2-1d56-4cd9-9fb3-87d37147881f", "tag": "778f57a0-7cf0-4efe-9b55-04da77cb372e"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:29.211100 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:29.217942 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-a416af94-78d0-404c-b748-5d220a092249 req-4be4c8fb-05af-4d77-890b-b9ca332e3a54 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:29.218367 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-a416af94-78d0-404c-b748-5d220a092249 req-4be4c8fb-05af-4d77-890b-b9ca332e3a54 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:29.222433 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:29.240733 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-a416af94-78d0-404c-b748-5d220a092249 req-4be4c8fb-05af-4d77-890b-b9ca332e3a54 service nova] Creating event network-changed:778f57a0-7cf0-4efe-9b55-04da77cb372e for instance a361a3b2-1d56-4cd9-9fb3-87d37147881f on hv-cinder-83735 Jun 16 17:34:29.247952 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-a416af94-78d0-404c-b748-5d220a092249 req-4be4c8fb-05af-4d77-890b-b9ca332e3a54 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044658 Jun 16 17:34:29.248873 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 517/1032] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:04.943504 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:04.951039 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-0d4a7421-6413-4180-8daa-545a24a46a9b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:04.951890 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-0d4a7421-6413-4180-8daa-545a24a46a9b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:04.960416 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d4a7421-6413-4180-8daa-545a24a46a9b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:04.960864 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d4a7421-6413-4180-8daa-545a24a46a9b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:04.961697 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d4a7421-6413-4180-8daa-545a24a46a9b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:04.962132 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-0d4a7421-6413-4180-8daa-545a24a46a9b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:04.988854 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-0d4a7421-6413-4180-8daa-545a24a46a9b tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f/ips" status: 200 len: 149 microversion: 2.1 time: 0.048080 Jun 16 17:35:04.989443 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 516/1033] 10.222.0.66 () {58 vars in 1247 bytes} [Thu Jun 16 17:35:04 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:06.371998 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-999b92fd-bbbd-4eb8-95c6-ddf739f5c0f0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25ad1f29-768b-4347-a2c2-73db408f0f2a"}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:06.373248 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-999b92fd-bbbd-4eb8-95c6-ddf739f5c0f0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:06.381895 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-999b92fd-bbbd-4eb8-95c6-ddf739f5c0f0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:06.382356 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-999b92fd-bbbd-4eb8-95c6-ddf739f5c0f0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:06.383236 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-999b92fd-bbbd-4eb8-95c6-ddf739f5c0f0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:06.383657 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-999b92fd-bbbd-4eb8-95c6-ddf739f5c0f0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:06.662506 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-999b92fd-bbbd-4eb8-95c6-ddf739f5c0f0 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "POST /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296404 Jun 16 17:35:06.663142 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 518/1034] 10.222.0.66 () {60 vars in 1322 bytes} [Thu Jun 16 17:35:06 2022] POST /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:13.306946 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-16e6a221-fefb-4ae3-bbc6-d2966c6b52df tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:13.307866 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-16e6a221-fefb-4ae3-bbc6-d2966c6b52df tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:13.315660 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-16e6a221-fefb-4ae3-bbc6-d2966c6b52df tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:13.316106 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-16e6a221-fefb-4ae3-bbc6-d2966c6b52df tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:13.316898 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-16e6a221-fefb-4ae3-bbc6-d2966c6b52df tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:13.317383 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-16e6a221-fefb-4ae3-bbc6-d2966c6b52df tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:13.417267 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.objects.instance [None req-16e6a221-fefb-4ae3-bbc6-d2966c6b52df tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lazy-loading 'services' on Instance uuid a361a3b2-1d56-4cd9-9fb3-87d37147881f {{(pid=117552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:35:13.499688 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-16e6a221-fefb-4ae3-bbc6-d2966c6b52df tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f/os-volume_attachments/25ad1f29-768b-4347-a2c2-73db408f0f2a" status: 202 len: 0 microversion: 2.1 time: 0.196656 Jun 16 17:35:13.500341 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 517/1035] 10.222.0.66 () {58 vars in 1415 bytes} [Thu Jun 16 17:35:13 2022] DELETE /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f/os-volume_attachments/25ad1f29-768b-4347-a2c2-73db408f0f2a => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:35:13.509688 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-db0d33a5-451c-4ab8-b0ca-f35c0a167429 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:13.510774 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-db0d33a5-451c-4ab8-b0ca-f35c0a167429 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:13.519014 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-db0d33a5-451c-4ab8-b0ca-f35c0a167429 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:13.519459 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-db0d33a5-451c-4ab8-b0ca-f35c0a167429 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:13.520236 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-db0d33a5-451c-4ab8-b0ca-f35c0a167429 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:13.520661 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-db0d33a5-451c-4ab8-b0ca-f35c0a167429 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:13.555109 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-db0d33a5-451c-4ab8-b0ca-f35c0a167429 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049800 Jun 16 17:35:13.555833 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 519/1036] 10.222.0.66 () {58 vars in 1301 bytes} [Thu Jun 16 17:35:13 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:14.571507 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-3d25af7f-f8ab-409b-900c-8fe4af654c6e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:14.572579 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-3d25af7f-f8ab-409b-900c-8fe4af654c6e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:14.579695 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3d25af7f-f8ab-409b-900c-8fe4af654c6e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:14.580123 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3d25af7f-f8ab-409b-900c-8fe4af654c6e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:14.581093 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3d25af7f-f8ab-409b-900c-8fe4af654c6e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:14.581578 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3d25af7f-f8ab-409b-900c-8fe4af654c6e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:14.613810 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-3d25af7f-f8ab-409b-900c-8fe4af654c6e tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048247 Jun 16 17:35:14.614383 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 518/1037] 10.222.0.66 () {58 vars in 1301 bytes} [Thu Jun 16 17:35:14 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:35:14.675406 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-2a0f0441-c135-45ff-b3d3-e28dd9e1d094 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:14.675989 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2a0f0441-c135-45ff-b3d3-e28dd9e1d094 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:14.682835 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2a0f0441-c135-45ff-b3d3-e28dd9e1d094 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:14.683280 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2a0f0441-c135-45ff-b3d3-e28dd9e1d094 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:14.684068 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2a0f0441-c135-45ff-b3d3-e28dd9e1d094 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:14.684496 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-2a0f0441-c135-45ff-b3d3-e28dd9e1d094 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:14.710926 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-2a0f0441-c135-45ff-b3d3-e28dd9e1d094 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Going to try to terminate instance {{(pid=117553) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:35:14.800744 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-2a0f0441-c135-45ff-b3d3-e28dd9e1d094 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 204 len: 0 microversion: 2.1 time: 0.128879 Jun 16 17:35:14.801403 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 520/1038] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:35:14 2022] DELETE /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:35:14.810027 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a915ca13-b7ba-455d-a1c2-1b58fa471ece tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:14.811023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a915ca13-b7ba-455d-a1c2-1b58fa471ece tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:14.817422 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a915ca13-b7ba-455d-a1c2-1b58fa471ece tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:14.817901 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a915ca13-b7ba-455d-a1c2-1b58fa471ece tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:14.818670 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a915ca13-b7ba-455d-a1c2-1b58fa471ece tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:14.819102 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a915ca13-b7ba-455d-a1c2-1b58fa471ece tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:14.959314 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a915ca13-b7ba-455d-a1c2-1b58fa471ece tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:14.968350 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a915ca13-b7ba-455d-a1c2-1b58fa471ece tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 200 len: 1682 microversion: 2.1 time: 0.162295 Jun 16 17:35:14.969318 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 519/1039] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:14 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:15.988152 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a3d0db9e-03be-45f6-aacc-ddb8d9e7cbe5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:15.988974 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a3d0db9e-03be-45f6-aacc-ddb8d9e7cbe5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:15.995887 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a3d0db9e-03be-45f6-aacc-ddb8d9e7cbe5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:15.996302 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a3d0db9e-03be-45f6-aacc-ddb8d9e7cbe5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:15.997105 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a3d0db9e-03be-45f6-aacc-ddb8d9e7cbe5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:15.997774 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a3d0db9e-03be-45f6-aacc-ddb8d9e7cbe5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:16.140437 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a3d0db9e-03be-45f6-aacc-ddb8d9e7cbe5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:16.148238 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a3d0db9e-03be-45f6-aacc-ddb8d9e7cbe5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 200 len: 1682 microversion: 2.1 time: 0.165177 Jun 16 17:35:16.148807 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 521/1040] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:15 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:17.167086 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-1b5ffd88-06db-41c7-bb87-c3af90368c0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:17.167715 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-1b5ffd88-06db-41c7-bb87-c3af90368c0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:17.175331 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1b5ffd88-06db-41c7-bb87-c3af90368c0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:17.175780 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1b5ffd88-06db-41c7-bb87-c3af90368c0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:17.176560 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1b5ffd88-06db-41c7-bb87-c3af90368c0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:17.176980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-1b5ffd88-06db-41c7-bb87-c3af90368c0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:17.262057 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-1b5ffd88-06db-41c7-bb87-c3af90368c0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ef5f213254d818de4888cca274311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56d4c430c44df49f48fe0b49ebcbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:17.272562 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-1b5ffd88-06db-41c7-bb87-c3af90368c0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 200 len: 1614 microversion: 2.1 time: 0.109320 Jun 16 17:35:17.279533 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 520/1041] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:17 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 1614 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:17.339004 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-673297cb-aa45-403a-9189-4c09dce335c8 req-98da21d5-593d-48a1-b306-936bc6c1cfb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a361a3b2-1d56-4cd9-9fb3-87d37147881f", "name": "network-vif-deleted", "tag": "778f57a0-7cf0-4efe-9b55-04da77cb372e"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:17.353342 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-673297cb-aa45-403a-9189-4c09dce335c8 req-98da21d5-593d-48a1-b306-936bc6c1cfb1 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:17.354076 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-673297cb-aa45-403a-9189-4c09dce335c8 req-98da21d5-593d-48a1-b306-936bc6c1cfb1 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:17.380948 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-673297cb-aa45-403a-9189-4c09dce335c8 req-98da21d5-593d-48a1-b306-936bc6c1cfb1 service nova] Creating event network-vif-deleted:778f57a0-7cf0-4efe-9b55-04da77cb372e for instance a361a3b2-1d56-4cd9-9fb3-87d37147881f on hv-cinder-83735 Jun 16 17:35:17.389666 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-673297cb-aa45-403a-9189-4c09dce335c8 req-98da21d5-593d-48a1-b306-936bc6c1cfb1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054351 Jun 16 17:35:17.395181 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 522/1042] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:18.298779 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-3c8d6c9d-887d-4364-b081-824abb723c3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:18.299807 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-3c8d6c9d-887d-4364-b081-824abb723c3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:18.310049 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3c8d6c9d-887d-4364-b081-824abb723c3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:18.310491 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3c8d6c9d-887d-4364-b081-824abb723c3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:18.311282 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3c8d6c9d-887d-4364-b081-824abb723c3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:18.311711 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3c8d6c9d-887d-4364-b081-824abb723c3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:18.329435 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-3c8d6c9d-887d-4364-b081-824abb723c3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] HTTP exception thrown: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-3c8d6c9d-887d-4364-b081-824abb723c3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Request method failure captured: Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f HTTP/1.1 Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2jM6nxeVPJ_wLeywFOVtPZVOjk2Azcj0dSHnDAG1HXTfbt4n-fL381ERvSVeK072jADPqj1sD3G1uOZtdFTAW3_goCrw2fh09FT00PBj6Cln_7T21eu3gbi01NC1WoSQikUS_PWuftzY2MpE3UZ8fXZ0l8IvFGGpbesg0Z3ABVthA4 Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:35:18.331011 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:35:18.332906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7c56d4c430c44df49f48fe0b49ebcbd2", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7c56d4c430c44df49f48fe0b49ebcbd2"}]}] Jun 16 17:35:18.332906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:18.332906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:18.332906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:18.332906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:18.332906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:35:18.332906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:35:18.332906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 642ef5f213254d818de4888cca274311 Jun 16 17:35:18.332906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:18.332906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:35:18.332906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. Jun 16 17:35:18.332906 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': 'a361a3b2-1d56-4cd9-9fb3-87d37147881f'} Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:35:18.333851 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. Jun 16 17:35:18.335330 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:18.336612 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-3c8d6c9d-887d-4364-b081-824abb723c3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Returning 404 to user: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:35:18.336612 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-3c8d6c9d-887d-4364-b081-824abb723c3a tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 404 len: 111 microversion: 2.1 time: 0.040217 Jun 16 17:35:18.336612 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 521/1043] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:18 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:35:18.347473 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-78df3a1c-120e-4f3b-a38e-da0442b94532 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '.version_select at 0x7f66b15d7d30>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:18.384385 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-78df3a1c-120e-4f3b-a38e-da0442b94532 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1886661746" status: 202 len: 0 microversion: 2.1 time: 0.044305 Jun 16 17:35:18.384982 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 523/1044] 10.222.0.66 () {58 vars in 1220 bytes} [Thu Jun 16 17:35:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1886661746 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:35:20.222888 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f9df881d-51e9-4658-8365-e332a95882d5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:20.224397 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f9df881d-51e9-4658-8365-e332a95882d5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:20.230701 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f9df881d-51e9-4658-8365-e332a95882d5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:20.231141 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f9df881d-51e9-4658-8365-e332a95882d5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:20.232080 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f9df881d-51e9-4658-8365-e332a95882d5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:20.232478 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f9df881d-51e9-4658-8365-e332a95882d5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:20.247605 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-f9df881d-51e9-4658-8365-e332a95882d5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] HTTP exception thrown: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f9df881d-51e9-4658-8365-e332a95882d5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Request method failure captured: Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: DELETE /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f HTTP/1.1 Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2jM6nxeVPJ_wLeywFOVtPZVOjk2Azcj0dSHnDAG1HXTfbt4n-fL381ERvSVeK072jADPqj1sD3G1uOZtdFTAW3_goCrw2fh09FT00PBj6Cln_7T21eu3gbi01NC1WoSQikUS_PWuftzY2MpE3UZ8fXZ0l8IvFGGpbesg0Z3ABVthA4 Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:35:20.249979 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:35:20.251653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7c56d4c430c44df49f48fe0b49ebcbd2", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7c56d4c430c44df49f48fe0b49ebcbd2"}]}] Jun 16 17:35:20.251653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:20.251653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:20.251653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:20.251653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:20.251653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:35:20.251653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:35:20.251653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 642ef5f213254d818de4888cca274311 Jun 16 17:35:20.251653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:20.251653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:35:20.251653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. Jun 16 17:35:20.251653 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': 'a361a3b2-1d56-4cd9-9fb3-87d37147881f'} Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:35:20.252786 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. Jun 16 17:35:20.254850 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:20.257768 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f9df881d-51e9-4658-8365-e332a95882d5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Returning 404 to user: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:35:20.257768 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f9df881d-51e9-4658-8365-e332a95882d5 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 404 len: 111 microversion: 2.1 time: 0.032640 Jun 16 17:35:20.257768 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 522/1045] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:35:20 2022] DELETE /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:35:20.262288 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-fba33ae7-af92-4ec4-b3b6-72afb3362ae9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:20.263337 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-fba33ae7-af92-4ec4-b3b6-72afb3362ae9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: a361a3b2-1d56-4cd9-9fb3-87d37147881f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:20.273225 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fba33ae7-af92-4ec4-b3b6-72afb3362ae9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:20.273859 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fba33ae7-af92-4ec4-b3b6-72afb3362ae9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:20.274742 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fba33ae7-af92-4ec4-b3b6-72afb3362ae9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:20.275387 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-fba33ae7-af92-4ec4-b3b6-72afb3362ae9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:20.291267 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-fba33ae7-af92-4ec4-b3b6-72afb3362ae9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] HTTP exception thrown: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-fba33ae7-af92-4ec4-b3b6-72afb3362ae9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Request method failure captured: Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f HTTP/1.1 Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2jM6nxeVPJ_wLeywFOVtPZVOjk2Azcj0dSHnDAG1HXTfbt4n-fL381ERvSVeK072jADPqj1sD3G1uOZtdFTAW3_goCrw2fh09FT00PBj6Cln_7T21eu3gbi01NC1WoSQikUS_PWuftzY2MpE3UZ8fXZ0l8IvFGGpbesg0Z3ABVthA4 Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:35:20.293809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:35:20.295427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7c56d4c430c44df49f48fe0b49ebcbd2", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7c56d4c430c44df49f48fe0b49ebcbd2"}]}] Jun 16 17:35:20.295427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:20.295427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:20.295427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:20.295427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:20.295427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:35:20.295427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:35:20.295427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: 642ef5f213254d818de4888cca274311 Jun 16 17:35:20.295427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:20.295427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:35:20.295427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. Jun 16 17:35:20.295427 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': 'a361a3b2-1d56-4cd9-9fb3-87d37147881f'} Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:35:20.296500 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. Jun 16 17:35:20.298301 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:20.299796 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-fba33ae7-af92-4ec4-b3b6-72afb3362ae9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Returning 404 to user: Instance a361a3b2-1d56-4cd9-9fb3-87d37147881f could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:35:20.299796 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-fba33ae7-af92-4ec4-b3b6-72afb3362ae9 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f" status: 404 len: 111 microversion: 2.1 time: 0.038206 Jun 16 17:35:20.299796 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 524/1046] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:20 2022] GET /compute/v2.1/servers/a361a3b2-1d56-4cd9-9fb3-87d37147881f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:35:21.461614 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7e4e8210-3ae8-4a3e-a5c8-ca772e0ded3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:21.462207 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-7e4e8210-3ae8-4a3e-a5c8-ca772e0ded3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:21.469369 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7e4e8210-3ae8-4a3e-a5c8-ca772e0ded3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:21.469821 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7e4e8210-3ae8-4a3e-a5c8-ca772e0ded3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:21.470635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7e4e8210-3ae8-4a3e-a5c8-ca772e0ded3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:21.471065 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-7e4e8210-3ae8-4a3e-a5c8-ca772e0ded3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:21.487879 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-7e4e8210-3ae8-4a3e-a5c8-ca772e0ded3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] HTTP exception thrown: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7e4e8210-3ae8-4a3e-a5c8-ca772e0ded3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Request method failure captured: Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: DELETE /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 HTTP/1.1 Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2jM6nxeVPJ_wLeywFOVtPZVOjk2Azcj0dSHnDAG1HXTfbt4n-fL381ERvSVeK072jADPqj1sD3G1uOZtdFTAW3_goCrw2fh09FT00PBj6Cln_7T21eu3gbi01NC1WoSQikUS_PWuftzY2MpE3UZ8fXZ0l8IvFGGpbesg0Z3ABVthA4 Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:35:21.489572 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:35:21.491575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7c56d4c430c44df49f48fe0b49ebcbd2", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7c56d4c430c44df49f48fe0b49ebcbd2"}]}] Jun 16 17:35:21.491575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:21.491575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:21.491575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:21.491575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:21.491575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:35:21.491575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:35:21.491575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 642ef5f213254d818de4888cca274311 Jun 16 17:35:21.491575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:21.491575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:35:21.491575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. Jun 16 17:35:21.491575 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': 'db95418d-ea53-4a5b-b942-3809e3cfec68'} Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:35:21.492454 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. Jun 16 17:35:21.494037 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.495987 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-7e4e8210-3ae8-4a3e-a5c8-ca772e0ded3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Returning 404 to user: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:35:21.495987 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-7e4e8210-3ae8-4a3e-a5c8-ca772e0ded3f tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "DELETE /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68" status: 404 len: 111 microversion: 2.1 time: 0.033460 Jun 16 17:35:21.495987 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 523/1047] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:35:21 2022] DELETE /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:35:21.499803 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-386de9ff-1aac-4906-ab6d-98a5a8bcb1a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:21.500411 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-386de9ff-1aac-4906-ab6d-98a5a8bcb1a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: db95418d-ea53-4a5b-b942-3809e3cfec68] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:21.507475 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-386de9ff-1aac-4906-ab6d-98a5a8bcb1a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:21.507927 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-386de9ff-1aac-4906-ab6d-98a5a8bcb1a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:21.508693 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-386de9ff-1aac-4906-ab6d-98a5a8bcb1a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:21.509120 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-386de9ff-1aac-4906-ab6d-98a5a8bcb1a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:21.524332 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-386de9ff-1aac-4906-ab6d-98a5a8bcb1a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] HTTP exception thrown: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-386de9ff-1aac-4906-ab6d-98a5a8bcb1a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Request method failure captured: Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 HTTP/1.1 Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2jM6nxeVPJ_wLeywFOVtPZVOjk2Azcj0dSHnDAG1HXTfbt4n-fL381ERvSVeK072jADPqj1sD3G1uOZtdFTAW3_goCrw2fh09FT00PBj6Cln_7T21eu3gbi01NC1WoSQikUS_PWuftzY2MpE3UZ8fXZ0l8IvFGGpbesg0Z3ABVthA4 Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:35:21.525920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:35:21.527668 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7c56d4c430c44df49f48fe0b49ebcbd2", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7c56d4c430c44df49f48fe0b49ebcbd2"}]}] Jun 16 17:35:21.527668 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:21.527668 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:21.527668 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:21.527668 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:21.527668 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:35:21.527668 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:35:21.527668 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: 642ef5f213254d818de4888cca274311 Jun 16 17:35:21.527668 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:21.527668 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:35:21.527668 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. Jun 16 17:35:21.527668 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': 'db95418d-ea53-4a5b-b942-3809e3cfec68'} Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:35:21.528627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. Jun 16 17:35:21.530358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.531768 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-386de9ff-1aac-4906-ab6d-98a5a8bcb1a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Returning 404 to user: Instance db95418d-ea53-4a5b-b942-3809e3cfec68 could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:35:21.531768 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-386de9ff-1aac-4906-ab6d-98a5a8bcb1a7 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68" status: 404 len: 111 microversion: 2.1 time: 0.031398 Jun 16 17:35:21.531768 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 525/1048] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:21 2022] GET /compute/v2.1/servers/db95418d-ea53-4a5b-b942-3809e3cfec68 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:35:21.536327 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c753142e-4b87-470c-b933-74181fbdcd0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:21.536810 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c753142e-4b87-470c-b933-74181fbdcd0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:21.543096 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c753142e-4b87-470c-b933-74181fbdcd0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:21.543536 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c753142e-4b87-470c-b933-74181fbdcd0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:21.544344 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c753142e-4b87-470c-b933-74181fbdcd0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:21.544778 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c753142e-4b87-470c-b933-74181fbdcd0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:21.560253 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-c753142e-4b87-470c-b933-74181fbdcd0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] HTTP exception thrown: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c753142e-4b87-470c-b933-74181fbdcd0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Request method failure captured: Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: DELETE /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc HTTP/1.1 Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2jM6nxeVPJ_wLeywFOVtPZVOjk2Azcj0dSHnDAG1HXTfbt4n-fL381ERvSVeK072jADPqj1sD3G1uOZtdFTAW3_goCrw2fh09FT00PBj6Cln_7T21eu3gbi01NC1WoSQikUS_PWuftzY2MpE3UZ8fXZ0l8IvFGGpbesg0Z3ABVthA4 Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:35:21.561908 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:35:21.563586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7c56d4c430c44df49f48fe0b49ebcbd2", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7c56d4c430c44df49f48fe0b49ebcbd2"}]}] Jun 16 17:35:21.563586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:21.563586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:21.563586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:21.563586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:21.563586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:35:21.563586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:35:21.563586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 642ef5f213254d818de4888cca274311 Jun 16 17:35:21.563586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:21.563586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:35:21.563586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. Jun 16 17:35:21.563586 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': 'c8ea27cc-1e25-4130-bf8a-60fbfb4801bc'} Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:35:21.564404 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. Jun 16 17:35:21.566362 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.567869 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c753142e-4b87-470c-b933-74181fbdcd0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Returning 404 to user: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:35:21.567869 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c753142e-4b87-470c-b933-74181fbdcd0c tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 404 len: 111 microversion: 2.1 time: 0.030885 Jun 16 17:35:21.567869 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 524/1049] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:35:21 2022] DELETE /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:35:21.571962 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4a321a27-7900-42f2-a0bc-8a2302eebf78 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:21.572572 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-4a321a27-7900-42f2-a0bc-8a2302eebf78 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: c8ea27cc-1e25-4130-bf8a-60fbfb4801bc] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:21.579402 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4a321a27-7900-42f2-a0bc-8a2302eebf78 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:21.579848 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4a321a27-7900-42f2-a0bc-8a2302eebf78 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:21.580658 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4a321a27-7900-42f2-a0bc-8a2302eebf78 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:21.583732 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-4a321a27-7900-42f2-a0bc-8a2302eebf78 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:21.601900 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-4a321a27-7900-42f2-a0bc-8a2302eebf78 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] HTTP exception thrown: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4a321a27-7900-42f2-a0bc-8a2302eebf78 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Request method failure captured: Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc HTTP/1.1 Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2jM6nxeVPJ_wLeywFOVtPZVOjk2Azcj0dSHnDAG1HXTfbt4n-fL381ERvSVeK072jADPqj1sD3G1uOZtdFTAW3_goCrw2fh09FT00PBj6Cln_7T21eu3gbi01NC1WoSQikUS_PWuftzY2MpE3UZ8fXZ0l8IvFGGpbesg0Z3ABVthA4 Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:35:21.604522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:35:21.606305 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7c56d4c430c44df49f48fe0b49ebcbd2", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7c56d4c430c44df49f48fe0b49ebcbd2"}]}] Jun 16 17:35:21.606305 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:21.606305 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:21.606305 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:21.606305 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:21.606305 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:35:21.606305 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:35:21.606305 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: 642ef5f213254d818de4888cca274311 Jun 16 17:35:21.606305 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:21.606305 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:35:21.606305 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. Jun 16 17:35:21.606305 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': 'c8ea27cc-1e25-4130-bf8a-60fbfb4801bc'} Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:35:21.607704 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. Jun 16 17:35:21.609677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:21.611283 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-4a321a27-7900-42f2-a0bc-8a2302eebf78 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Returning 404 to user: Instance c8ea27cc-1e25-4130-bf8a-60fbfb4801bc could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:35:21.611283 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-4a321a27-7900-42f2-a0bc-8a2302eebf78 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc" status: 404 len: 111 microversion: 2.1 time: 0.037917 Jun 16 17:35:21.611283 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 526/1050] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:21 2022] GET /compute/v2.1/servers/c8ea27cc-1e25-4130-bf8a-60fbfb4801bc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:35:22.769396 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8e0c81a5-85f5-4eb3-9854-ae2c919018d6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:22.770150 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-8e0c81a5-85f5-4eb3-9854-ae2c919018d6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:22.776848 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8e0c81a5-85f5-4eb3-9854-ae2c919018d6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:22.777313 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8e0c81a5-85f5-4eb3-9854-ae2c919018d6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:22.778094 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8e0c81a5-85f5-4eb3-9854-ae2c919018d6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:22.778592 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-8e0c81a5-85f5-4eb3-9854-ae2c919018d6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:22.794140 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-8e0c81a5-85f5-4eb3-9854-ae2c919018d6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] HTTP exception thrown: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8e0c81a5-85f5-4eb3-9854-ae2c919018d6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Request method failure captured: Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: DELETE /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c HTTP/1.1 Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2jM6nxeVPJ_wLeywFOVtPZVOjk2Azcj0dSHnDAG1HXTfbt4n-fL381ERvSVeK072jADPqj1sD3G1uOZtdFTAW3_goCrw2fh09FT00PBj6Cln_7T21eu3gbi01NC1WoSQikUS_PWuftzY2MpE3UZ8fXZ0l8IvFGGpbesg0Z3ABVthA4 Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:35:22.796165 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:35:22.798264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7c56d4c430c44df49f48fe0b49ebcbd2", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7c56d4c430c44df49f48fe0b49ebcbd2"}]}] Jun 16 17:35:22.798264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:22.798264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:22.798264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:22.798264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:22.798264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:35:22.798264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:35:22.798264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 642ef5f213254d818de4888cca274311 Jun 16 17:35:22.798264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:22.798264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:35:22.798264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. Jun 16 17:35:22.798264 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': '4dce5739-2ecb-43f7-a49a-a9870cf2243c'} Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:35:22.799200 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. Jun 16 17:35:22.801023 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:35:22.802779 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-8e0c81a5-85f5-4eb3-9854-ae2c919018d6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Returning 404 to user: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:35:22.802779 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-8e0c81a5-85f5-4eb3-9854-ae2c919018d6 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c" status: 404 len: 111 microversion: 2.1 time: 0.032405 Jun 16 17:35:22.802779 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 525/1051] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:35:22 2022] DELETE /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:35:22.806065 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7757fa55-89de-470d-bcd2-37f0d4574ed4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:22.806672 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-7757fa55-89de-470d-bcd2-37f0d4574ed4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] [instance: 4dce5739-2ecb-43f7-a49a-a9870cf2243c] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:22.813894 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7757fa55-89de-470d-bcd2-37f0d4574ed4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:22.814295 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7757fa55-89de-470d-bcd2-37f0d4574ed4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:22.815071 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7757fa55-89de-470d-bcd2-37f0d4574ed4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:22.815531 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7757fa55-89de-470d-bcd2-37f0d4574ed4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:22.831457 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-7757fa55-89de-470d-bcd2-37f0d4574ed4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] HTTP exception thrown: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7757fa55-89de-470d-bcd2-37f0d4574ed4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Request method failure captured: Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c HTTP/1.1 Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2jM6nxeVPJ_wLeywFOVtPZVOjk2Azcj0dSHnDAG1HXTfbt4n-fL381ERvSVeK072jADPqj1sD3G1uOZtdFTAW3_goCrw2fh09FT00PBj6Cln_7T21eu3gbi01NC1WoSQikUS_PWuftzY2MpE3UZ8fXZ0l8IvFGGpbesg0Z3ABVthA4 Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:35:22.833011 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:35:22.835489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7c56d4c430c44df49f48fe0b49ebcbd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7c56d4c430c44df49f48fe0b49ebcbd2", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7c56d4c430c44df49f48fe0b49ebcbd2"}]}] Jun 16 17:35:22.835489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:22.835489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: 7c56d4c430c44df49f48fe0b49ebcbd2 Jun 16 17:35:22.835489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1307848981 Jun 16 17:35:22.835489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:22.835489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:35:22.835489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:35:22.835489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: 642ef5f213254d818de4888cca274311 Jun 16 17:35:22.835489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-AttachVolumeNegativeTest-1307848981-project Jun 16 17:35:22.835489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:35:22.835489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. Jun 16 17:35:22.835489 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': '4dce5739-2ecb-43f7-a49a-a9870cf2243c'} Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:35:22.837354 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. Jun 16 17:35:22.839871 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:35:22.842158 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7757fa55-89de-470d-bcd2-37f0d4574ed4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] Returning 404 to user: Instance 4dce5739-2ecb-43f7-a49a-a9870cf2243c could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:35:22.842158 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7757fa55-89de-470d-bcd2-37f0d4574ed4 tempest-AttachVolumeNegativeTest-1307848981 tempest-AttachVolumeNegativeTest-1307848981-project] 10.222.0.66 "GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c" status: 404 len: 111 microversion: 2.1 time: 0.032513 Jun 16 17:35:22.842158 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 527/1052] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:22 2022] GET /compute/v2.1/servers/4dce5739-2ecb-43f7-a49a-a9870cf2243c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:35:29.070164 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-084bad7b-66fb-48cf-a80e-0851094aa93a tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] Calling method '.version_select at 0x7f66b156e700>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:29.121531 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-084bad7b-66fb-48cf-a80e-0851094aa93a tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e2ff90c2-0f8f-4a4f-baf4-014ccef339ca" status: 200 len: 350 microversion: 2.1 time: 0.055099 Jun 16 17:35:29.122506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 526/1053] 10.222.0.66 () {58 vars in 1244 bytes} [Thu Jun 16 17:35:29 2022] GET /compute/v2.1/os-volumes/e2ff90c2-0f8f-4a4f-baf4-014ccef339ca => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:30.473293 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8697de39-fbe2-4ac1-af9d-143b76dbe935 tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] Calling method '.version_select at 0x7f66b35a0790>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:30.524970 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8697de39-fbe2-4ac1-af9d-143b76dbe935 tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/8aae3af4-9e74-4ffe-b479-9a17c967fdd6" status: 200 len: 350 microversion: 2.1 time: 0.055582 Jun 16 17:35:30.525723 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 528/1054] 10.222.0.66 () {58 vars in 1244 bytes} [Thu Jun 16 17:35:30 2022] GET /compute/v2.1/os-volumes/8aae3af4-9e74-4ffe-b479-9a17c967fdd6 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:31.878480 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-540a188f-234c-4ae5-b558-adb03d3ca98f tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] Calling method '.version_select at 0x7f66b1770d30>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:31.927419 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-540a188f-234c-4ae5-b558-adb03d3ca98f tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/7fef4b09-37d4-4fae-8539-5454dfe97cf4" status: 200 len: 351 microversion: 2.1 time: 0.053227 Jun 16 17:35:31.927991 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 527/1055] 10.222.0.66 () {58 vars in 1244 bytes} [Thu Jun 16 17:35:31 2022] GET /compute/v2.1/os-volumes/7fef4b09-37d4-4fae-8539-5454dfe97cf4 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:31.940078 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-97bdd606-b152-4884-8b57-46a96750bfdc tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] Calling method '.version_select at 0x7f66b1a5f8b0>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:32.028117 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-97bdd606-b152-4884-8b57-46a96750bfdc tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.092078 Jun 16 17:35:32.029070 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 529/1056] 10.222.0.66 () {58 vars in 1133 bytes} [Thu Jun 16 17:35:31 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:32.041158 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-547c9de2-e9c8-485f-b08c-2fadd503d6ee tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] Calling method '.version_select at 0x7f66b165b790>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:32.127238 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-547c9de2-e9c8-485f-b08c-2fadd503d6ee tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089778 Jun 16 17:35:32.127831 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 528/1057] 10.222.0.66 () {58 vars in 1148 bytes} [Thu Jun 16 17:35:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:32.140149 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7173dfc5-37c9-4d1e-acc0-54057765031b tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] Calling method '.version_select at 0x7f66b15cfaf0>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:32.230269 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7173dfc5-37c9-4d1e-acc0-54057765031b tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.094026 Jun 16 17:35:32.230835 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 530/1058] 10.222.0.66 () {58 vars in 1133 bytes} [Thu Jun 16 17:35:32 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:32.243245 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-4128a621-4ded-40d5-99a4-cab537a6d684 tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] Calling method '.version_select at 0x7f66b1626550>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:32.331384 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-4128a621-4ded-40d5-99a4-cab537a6d684 tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092015 Jun 16 17:35:32.331929 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 529/1059] 10.222.0.66 () {58 vars in 1166 bytes} [Thu Jun 16 17:35:32 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:32.344313 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-e71c34cc-5deb-45c5-beaa-0d35882ae192 tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] Calling method '.version_select at 0x7f66b17d8c10>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:32.429454 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-e71c34cc-5deb-45c5-beaa-0d35882ae192 tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089310 Jun 16 17:35:32.430030 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 531/1060] 10.222.0.66 () {58 vars in 1169 bytes} [Thu Jun 16 17:35:32 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:32.444481 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-85d54d04-a0e3-4d24-b40e-46410c13b2a4 tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] Calling method '.version_select at 0x7f66b15ae790>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:32.528669 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-85d54d04-a0e3-4d24-b40e-46410c13b2a4 tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.090045 Jun 16 17:35:32.529254 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 530/1061] 10.222.0.66 () {58 vars in 1154 bytes} [Thu Jun 16 17:35:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:32.540388 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-b8ff984b-bb28-4691-80cd-6873ae1ba7db tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] Calling method '.version_select at 0x7f66b1832c10>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:32.628670 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-b8ff984b-bb28-4691-80cd-6873ae1ba7db tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092053 Jun 16 17:35:32.629252 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 532/1062] 10.222.0.66 () {58 vars in 1187 bytes} [Thu Jun 16 17:35:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:32.641676 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9b28b899-f438-4906-b08c-2f125b8a34d2 tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] Calling method '.version_select at 0x7f66b1537040>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:32.774064 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=20 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:32.784105 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:32.911881 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9b28b899-f438-4906-b08c-2f125b8a34d2 tempest-VolumesTestJSON-807036399 tempest-VolumesTestJSON-807036399-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.274674 Jun 16 17:35:32.912661 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 531/1063] 10.222.0.66 () {58 vars in 1154 bytes} [Thu Jun 16 17:35:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:07.680048 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:07.680810 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:07.686345 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-02e7fc19-1cd3-45ed-91d7-a0b91a2733c2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1980480036", "imageRef": "c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1", "flavorRef": "452", "networks": [{"uuid": "f24358e4-fd71-43f9-a3b7-69d150f32c61"}]}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:07.754488 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.network.neutron [None req-02e7fc19-1cd3-45ed-91d7-a0b91a2733c2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] validate_networks() for [('f24358e4-fd71-43f9-a3b7-69d150f32c61', None, None, None, None, None)] {{(pid=117553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:36:08.156812 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-02e7fc19-1cd3-45ed-91d7-a0b91a2733c2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Flavor limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:36:08.157260 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-02e7fc19-1cd3-45ed-91d7-a0b91a2733c2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Image limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:36:08.157699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-02e7fc19-1cd3-45ed-91d7-a0b91a2733c2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Flavor pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:36:08.158096 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-02e7fc19-1cd3-45ed-91d7-a0b91a2733c2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Image pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:36:08.158502 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-02e7fc19-1cd3-45ed-91d7-a0b91a2733c2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:36:08.168333 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-02e7fc19-1cd3-45ed-91d7-a0b91a2733c2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:08.168774 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-02e7fc19-1cd3-45ed-91d7-a0b91a2733c2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:08.169623 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-02e7fc19-1cd3-45ed-91d7-a0b91a2733c2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:08.170053 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-02e7fc19-1cd3-45ed-91d7-a0b91a2733c2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:08.187904 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-02e7fc19-1cd3-45ed-91d7-a0b91a2733c2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Getting quotas for project 09d39fa8db0747f9b8237807b2735d5c. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:36:08.192023 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-02e7fc19-1cd3-45ed-91d7-a0b91a2733c2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Getting quotas for user 6833efa3f23d44a6b10d6b82e0b2b38c and project 09d39fa8db0747f9b8237807b2735d5c. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:36:08.203847 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-02e7fc19-1cd3-45ed-91d7-a0b91a2733c2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Going to run 1 instances... {{(pid=117553) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:36:08.206187 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-02e7fc19-1cd3-45ed-91d7-a0b91a2733c2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:36:08.256148 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-02e7fc19-1cd3-45ed-91d7-a0b91a2733c2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576749 Jun 16 17:36:08.262588 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 533/1064] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:36:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:36:08.268563 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-89b1ac52-412d-4323-b706-68cbb7dbb407 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:08.269399 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-89b1ac52-412d-4323-b706-68cbb7dbb407 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:08.332794 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-89b1ac52-412d-4323-b706-68cbb7dbb407 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:08.343815 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-89b1ac52-412d-4323-b706-68cbb7dbb407 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f" status: 200 len: 1214 microversion: 2.1 time: 0.079802 Jun 16 17:36:08.344400 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 532/1065] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:08 2022] GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:09.363490 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8bc1c84b-4fcd-46ee-81d7-cd04c724ce8f tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:09.374368 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-8bc1c84b-4fcd-46ee-81d7-cd04c724ce8f tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:09.374368 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8bc1c84b-4fcd-46ee-81d7-cd04c724ce8f tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:09.374368 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8bc1c84b-4fcd-46ee-81d7-cd04c724ce8f tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:09.374368 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8bc1c84b-4fcd-46ee-81d7-cd04c724ce8f tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:09.374818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8bc1c84b-4fcd-46ee-81d7-cd04c724ce8f tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:09.438449 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8bc1c84b-4fcd-46ee-81d7-cd04c724ce8f tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:09.449707 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8bc1c84b-4fcd-46ee-81d7-cd04c724ce8f tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f" status: 200 len: 1266 microversion: 2.1 time: 0.091564 Jun 16 17:36:09.450234 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 534/1066] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:09 2022] GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:10.466997 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-f264961c-6bb5-4326-8d6b-9b4db13a5e03 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:10.467602 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-f264961c-6bb5-4326-8d6b-9b4db13a5e03 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:10.474959 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f264961c-6bb5-4326-8d6b-9b4db13a5e03 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:10.475429 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f264961c-6bb5-4326-8d6b-9b4db13a5e03 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:10.476181 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f264961c-6bb5-4326-8d6b-9b4db13a5e03 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:10.476603 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-f264961c-6bb5-4326-8d6b-9b4db13a5e03 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:10.697498 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-f264961c-6bb5-4326-8d6b-9b4db13a5e03 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:10.705750 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-f264961c-6bb5-4326-8d6b-9b4db13a5e03 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f" status: 200 len: 1314 microversion: 2.1 time: 0.242738 Jun 16 17:36:10.706335 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 533/1067] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:10 2022] GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:11.006624 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-78adc846-8ba2-4ec4-a540-6bb7630def73 req-8d62410c-5471-4b38-a658-625c5f85aeba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba6cc107-9e30-4e1b-a561-5f3871c8998f", "tag": "6731f87c-a7e3-4ba8-b455-b9138786ab16"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:11.015944 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-78adc846-8ba2-4ec4-a540-6bb7630def73 req-8d62410c-5471-4b38-a658-625c5f85aeba service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:11.016476 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-78adc846-8ba2-4ec4-a540-6bb7630def73 req-8d62410c-5471-4b38-a658-625c5f85aeba service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:11.034553 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-78adc846-8ba2-4ec4-a540-6bb7630def73 req-8d62410c-5471-4b38-a658-625c5f85aeba service nova] Creating event network-changed:6731f87c-a7e3-4ba8-b455-b9138786ab16 for instance ba6cc107-9e30-4e1b-a561-5f3871c8998f on hv-cinder-83735 Jun 16 17:36:11.039482 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-78adc846-8ba2-4ec4-a540-6bb7630def73 req-8d62410c-5471-4b38-a658-625c5f85aeba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036721 Jun 16 17:36:11.040100 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 535/1068] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:11.723659 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-3fd93c06-ce65-4d15-b917-e49ce337a4d7 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:11.724272 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-3fd93c06-ce65-4d15-b917-e49ce337a4d7 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:11.731263 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3fd93c06-ce65-4d15-b917-e49ce337a4d7 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:11.731710 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3fd93c06-ce65-4d15-b917-e49ce337a4d7 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:11.732475 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3fd93c06-ce65-4d15-b917-e49ce337a4d7 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:11.732941 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-3fd93c06-ce65-4d15-b917-e49ce337a4d7 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:11.881541 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-3fd93c06-ce65-4d15-b917-e49ce337a4d7 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:11.890161 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-3fd93c06-ce65-4d15-b917-e49ce337a4d7 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f" status: 200 len: 1314 microversion: 2.1 time: 0.170468 Jun 16 17:36:11.890730 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 534/1069] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:11 2022] GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:12.909847 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-9c375f11-48a7-431c-95df-705aadaf1ed0 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:12.910534 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-9c375f11-48a7-431c-95df-705aadaf1ed0 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:12.917632 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9c375f11-48a7-431c-95df-705aadaf1ed0 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:12.918079 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9c375f11-48a7-431c-95df-705aadaf1ed0 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:12.918845 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9c375f11-48a7-431c-95df-705aadaf1ed0 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:12.919276 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9c375f11-48a7-431c-95df-705aadaf1ed0 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:13.067057 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-9c375f11-48a7-431c-95df-705aadaf1ed0 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:13.076146 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-9c375f11-48a7-431c-95df-705aadaf1ed0 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f" status: 200 len: 1314 microversion: 2.1 time: 0.172172 Jun 16 17:36:13.076705 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 536/1070] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:12 2022] GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:14.096662 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c7f17f5b-d0c3-495d-a475-d369f6425338 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:14.097343 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c7f17f5b-d0c3-495d-a475-d369f6425338 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:14.106822 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c7f17f5b-d0c3-495d-a475-d369f6425338 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:14.107312 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c7f17f5b-d0c3-495d-a475-d369f6425338 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:14.108065 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c7f17f5b-d0c3-495d-a475-d369f6425338 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:14.108491 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-c7f17f5b-d0c3-495d-a475-d369f6425338 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:14.248623 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c7f17f5b-d0c3-495d-a475-d369f6425338 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:14.258759 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c7f17f5b-d0c3-495d-a475-d369f6425338 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f" status: 200 len: 1314 microversion: 2.1 time: 0.168399 Jun 16 17:36:14.259327 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 535/1071] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:14 2022] GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:15.275578 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-9f360519-aa5f-40a7-9b5e-08b98b34bc39 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:15.276194 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-9f360519-aa5f-40a7-9b5e-08b98b34bc39 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:15.283089 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9f360519-aa5f-40a7-9b5e-08b98b34bc39 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:15.283522 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9f360519-aa5f-40a7-9b5e-08b98b34bc39 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:15.284274 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9f360519-aa5f-40a7-9b5e-08b98b34bc39 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:15.284735 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-9f360519-aa5f-40a7-9b5e-08b98b34bc39 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:15.418966 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-9f360519-aa5f-40a7-9b5e-08b98b34bc39 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:15.427374 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-9f360519-aa5f-40a7-9b5e-08b98b34bc39 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f" status: 200 len: 1314 microversion: 2.1 time: 0.155690 Jun 16 17:36:15.428096 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 537/1072] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:15 2022] GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:16.449329 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-9721ded2-4fa0-4f82-b109-31e729f3228c tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:16.449921 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-9721ded2-4fa0-4f82-b109-31e729f3228c tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:16.457036 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9721ded2-4fa0-4f82-b109-31e729f3228c tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:16.457522 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9721ded2-4fa0-4f82-b109-31e729f3228c tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:16.458333 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9721ded2-4fa0-4f82-b109-31e729f3228c tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:16.458754 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-9721ded2-4fa0-4f82-b109-31e729f3228c tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:16.608822 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-9721ded2-4fa0-4f82-b109-31e729f3228c tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:16.616821 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-9721ded2-4fa0-4f82-b109-31e729f3228c tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f" status: 200 len: 1314 microversion: 2.1 time: 0.172922 Jun 16 17:36:16.617426 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 536/1073] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:16 2022] GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:17.299738 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-65d75904-960b-4ed9-b5e1-1956fbbd4a9d req-15d46ef9-5a46-4bcc-a75a-3810de078991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6cc107-9e30-4e1b-a561-5f3871c8998f", "name": "network-vif-plugged", "status": "completed", "tag": "6731f87c-a7e3-4ba8-b455-b9138786ab16"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:17.309826 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-65d75904-960b-4ed9-b5e1-1956fbbd4a9d req-15d46ef9-5a46-4bcc-a75a-3810de078991 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:17.310252 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-65d75904-960b-4ed9-b5e1-1956fbbd4a9d req-15d46ef9-5a46-4bcc-a75a-3810de078991 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:17.324104 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-65d75904-960b-4ed9-b5e1-1956fbbd4a9d req-15d46ef9-5a46-4bcc-a75a-3810de078991 service nova] Creating event network-vif-plugged:6731f87c-a7e3-4ba8-b455-b9138786ab16 for instance ba6cc107-9e30-4e1b-a561-5f3871c8998f on hv-cinder-83735 Jun 16 17:36:17.329746 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-65d75904-960b-4ed9-b5e1-1956fbbd4a9d req-15d46ef9-5a46-4bcc-a75a-3810de078991 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034226 Jun 16 17:36:17.330812 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 538/1074] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:17.637098 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-a0c129f3-7068-499a-97ca-4448d222c5b2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:17.637677 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-a0c129f3-7068-499a-97ca-4448d222c5b2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:17.644825 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a0c129f3-7068-499a-97ca-4448d222c5b2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:17.645304 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a0c129f3-7068-499a-97ca-4448d222c5b2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:17.646049 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a0c129f3-7068-499a-97ca-4448d222c5b2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:17.646473 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-a0c129f3-7068-499a-97ca-4448d222c5b2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:17.791348 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-a0c129f3-7068-499a-97ca-4448d222c5b2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:17.800598 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-a0c129f3-7068-499a-97ca-4448d222c5b2 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f" status: 200 len: 1314 microversion: 2.1 time: 0.167404 Jun 16 17:36:17.801163 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 537/1075] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:17 2022] GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:18.826088 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-47f65263-d8bf-4615-803a-53e792f16f22 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:18.827195 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-47f65263-d8bf-4615-803a-53e792f16f22 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:18.830375 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:18.831253 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=6 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:18.841131 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-47f65263-d8bf-4615-803a-53e792f16f22 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:18.842120 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-47f65263-d8bf-4615-803a-53e792f16f22 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:18.842903 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-47f65263-d8bf-4615-803a-53e792f16f22 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:18.843336 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-47f65263-d8bf-4615-803a-53e792f16f22 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:18.995727 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-47f65263-d8bf-4615-803a-53e792f16f22 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:19.005634 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-47f65263-d8bf-4615-803a-53e792f16f22 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f" status: 200 len: 1314 microversion: 2.1 time: 0.187106 Jun 16 17:36:19.006207 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 539/1076] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:18 2022] GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:20.023423 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-d84f8f01-db43-4ea4-a015-1f3911440190 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:20.023966 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-d84f8f01-db43-4ea4-a015-1f3911440190 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:20.026817 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:20.034670 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d84f8f01-db43-4ea4-a015-1f3911440190 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:20.035256 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d84f8f01-db43-4ea4-a015-1f3911440190 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:20.036066 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d84f8f01-db43-4ea4-a015-1f3911440190 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:20.036661 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-d84f8f01-db43-4ea4-a015-1f3911440190 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:20.199376 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-d84f8f01-db43-4ea4-a015-1f3911440190 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:20.210642 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-d84f8f01-db43-4ea4-a015-1f3911440190 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f" status: 200 len: 1498 microversion: 2.1 time: 0.191412 Jun 16 17:36:20.211416 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 538/1077] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:20 2022] GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f => generated 1498 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:20.647446 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-3325e7b3-0a6a-4a68-9e5e-9f45f2ec3db7 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:20.647972 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-3325e7b3-0a6a-4a68-9e5e-9f45f2ec3db7 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:20.655578 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3325e7b3-0a6a-4a68-9e5e-9f45f2ec3db7 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:20.656030 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3325e7b3-0a6a-4a68-9e5e-9f45f2ec3db7 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:20.656798 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3325e7b3-0a6a-4a68-9e5e-9f45f2ec3db7 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:20.657235 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3325e7b3-0a6a-4a68-9e5e-9f45f2ec3db7 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:20.684265 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-3325e7b3-0a6a-4a68-9e5e-9f45f2ec3db7 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] Going to try to terminate instance {{(pid=117553) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:36:20.786446 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-3325e7b3-0a6a-4a68-9e5e-9f45f2ec3db7 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f" status: 204 len: 0 microversion: 2.1 time: 0.142763 Jun 16 17:36:20.787205 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 540/1078] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:36:20 2022] DELETE /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:36:20.796911 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-65fa870c-2216-41dd-8c3a-b7aa3b07b606 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:20.797549 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-65fa870c-2216-41dd-8c3a-b7aa3b07b606 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:20.803828 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-65fa870c-2216-41dd-8c3a-b7aa3b07b606 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:20.804269 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-65fa870c-2216-41dd-8c3a-b7aa3b07b606 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:20.805019 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-65fa870c-2216-41dd-8c3a-b7aa3b07b606 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:20.805504 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-65fa870c-2216-41dd-8c3a-b7aa3b07b606 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:20.937086 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-65fa870c-2216-41dd-8c3a-b7aa3b07b606 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:20.944822 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-65fa870c-2216-41dd-8c3a-b7aa3b07b606 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f" status: 200 len: 1504 microversion: 2.1 time: 0.151728 Jun 16 17:36:20.945412 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 539/1079] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:20 2022] GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:21.963698 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-0de58fb1-3d7f-4fa7-a1d8-45556a32dd5d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:21.964609 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-0de58fb1-3d7f-4fa7-a1d8-45556a32dd5d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:21.971633 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0de58fb1-3d7f-4fa7-a1d8-45556a32dd5d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:21.972086 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0de58fb1-3d7f-4fa7-a1d8-45556a32dd5d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:21.972845 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0de58fb1-3d7f-4fa7-a1d8-45556a32dd5d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:21.973304 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-0de58fb1-3d7f-4fa7-a1d8-45556a32dd5d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:22.128331 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-0de58fb1-3d7f-4fa7-a1d8-45556a32dd5d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:22.137916 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-0de58fb1-3d7f-4fa7-a1d8-45556a32dd5d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f" status: 200 len: 1504 microversion: 2.1 time: 0.178990 Jun 16 17:36:22.138676 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 541/1080] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:21 2022] GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:22.710754 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-3117aef8-a424-42d1-9b19-ed9d472747d9 req-58225bba-7af2-41ac-85c7-4f2c2756dcb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6cc107-9e30-4e1b-a561-5f3871c8998f", "name": "network-vif-deleted", "tag": "6731f87c-a7e3-4ba8-b455-b9138786ab16"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:22.719686 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-3117aef8-a424-42d1-9b19-ed9d472747d9 req-58225bba-7af2-41ac-85c7-4f2c2756dcb2 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:22.720147 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-3117aef8-a424-42d1-9b19-ed9d472747d9 req-58225bba-7af2-41ac-85c7-4f2c2756dcb2 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:22.732192 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-3117aef8-a424-42d1-9b19-ed9d472747d9 req-58225bba-7af2-41ac-85c7-4f2c2756dcb2 service nova] Creating event network-vif-deleted:6731f87c-a7e3-4ba8-b455-b9138786ab16 for instance ba6cc107-9e30-4e1b-a561-5f3871c8998f on hv-cinder-83735 Jun 16 17:36:22.737962 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-3117aef8-a424-42d1-9b19-ed9d472747d9 req-58225bba-7af2-41ac-85c7-4f2c2756dcb2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030761 Jun 16 17:36:22.738448 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 540/1081] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:23.160021 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-3ec333df-607d-4b42-a9b9-6728eb142912 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:23.161145 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-3ec333df-607d-4b42-a9b9-6728eb142912 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:23.170438 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3ec333df-607d-4b42-a9b9-6728eb142912 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:23.171550 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3ec333df-607d-4b42-a9b9-6728eb142912 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:23.172742 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3ec333df-607d-4b42-a9b9-6728eb142912 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:23.173488 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3ec333df-607d-4b42-a9b9-6728eb142912 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:23.215726 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3ec333df-607d-4b42-a9b9-6728eb142912 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:23.216138 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-3ec333df-607d-4b42-a9b9-6728eb142912 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:23.216577 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.objects.instance [None req-3ec333df-607d-4b42-a9b9-6728eb142912 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lazy-loading 'fault' on Instance uuid ba6cc107-9e30-4e1b-a561-5f3871c8998f {{(pid=117553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:36:23.259256 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-3ec333df-607d-4b42-a9b9-6728eb142912 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:23.266409 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-3ec333df-607d-4b42-a9b9-6728eb142912 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f" status: 200 len: 1304 microversion: 2.1 time: 0.111797 Jun 16 17:36:23.266981 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 542/1082] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:23 2022] GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:24.285006 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-4d172f2e-f562-4d79-add1-13d39d6567de tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:24.285831 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-4d172f2e-f562-4d79-add1-13d39d6567de tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: ba6cc107-9e30-4e1b-a561-5f3871c8998f] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:24.292890 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4d172f2e-f562-4d79-add1-13d39d6567de tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:24.293269 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4d172f2e-f562-4d79-add1-13d39d6567de tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:24.294028 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4d172f2e-f562-4d79-add1-13d39d6567de tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:24.294449 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-4d172f2e-f562-4d79-add1-13d39d6567de tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:24.308052 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.wsgi [None req-4d172f2e-f562-4d79-add1-13d39d6567de tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] HTTP exception thrown: Instance ba6cc107-9e30-4e1b-a561-5f3871c8998f could not be found. Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-4d172f2e-f562-4d79-add1-13d39d6567de tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Request method failure captured: Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: request: GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f HTTP/1.1 Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept: application/json Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Accept-Encoding: identity Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Connection: close Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Length: 0 Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Content-Type: application/json Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Host: 10.222.0.66 Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Openstack-System-Scope: None Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: User-Agent: python-urllib3/1.26.9 Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Auth-Token: gAAAAABiq2oGyQsjf2doveewAClVmX_XwmSy2Jfy_Q6JrLpv048SGZ2jWdccw9xmb_5Rtm0toLaMiNcdMnXIIntqbo5o-qAbmyoam2F57CHy-sF6H__55FqzcCr_C5O2rH2OBcA5iEJAYKpTqVJ7ozsZXpVIpiJDG276Pzl_UI9SHfT_ZHwsAk8 Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Id: None Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Domain-Name: None Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Identity-Status: Confirmed Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Is-Admin-Project: True Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Id: default Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Domain-Name: Default Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Id: 09d39fa8db0747f9b8237807b2735d5c Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Project-Name: tempest-VolumesActionsTest-934369678 Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Role: reader,member Jun 16 17:36:24.310925 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Roles: reader,member Jun 16 17:36:24.313436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/09d39fa8db0747f9b8237807b2735d5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/09d39fa8db0747f9b8237807b2735d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_09d39fa8db0747f9b8237807b2735d5c", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/09d39fa8db0747f9b8237807b2735d5c"}]}] Jun 16 17:36:24.313436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant: tempest-VolumesActionsTest-934369678 Jun 16 17:36:24.313436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Id: 09d39fa8db0747f9b8237807b2735d5c Jun 16 17:36:24.313436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-Tenant-Name: tempest-VolumesActionsTest-934369678 Jun 16 17:36:24.313436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User: tempest-VolumesActionsTest-934369678-project Jun 16 17:36:24.313436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Id: default Jun 16 17:36:24.313436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Domain-Name: Default Jun 16 17:36:24.313436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Id: 6833efa3f23d44a6b10d6b82e0b2b38c Jun 16 17:36:24.313436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: X-User-Name: tempest-VolumesActionsTest-934369678-project Jun 16 17:36:24.313436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: method: > Jun 16 17:36:24.313436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: exception: Instance ba6cc107-9e30-4e1b-a561-5f3871c8998f could not be found. Jun 16 17:36:24.313436 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: action_args: {'id': 'ba6cc107-9e30-4e1b-a561-5f3871c8998f'} Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba6cc107-9e30-4e1b-a561-5f3871c8998f could not be found. Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:36:24.315078 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba6cc107-9e30-4e1b-a561-5f3871c8998f could not be found. Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba6cc107-9e30-4e1b-a561-5f3871c8998f could not be found. Jun 16 17:36:24.317242 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: ERROR nova.api.openstack.wsgi Jun 16 17:36:24.318900 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-4d172f2e-f562-4d79-add1-13d39d6567de tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Returning 404 to user: Instance ba6cc107-9e30-4e1b-a561-5f3871c8998f could not be found. {{(pid=117552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:36:24.318900 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-4d172f2e-f562-4d79-add1-13d39d6567de tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f" status: 404 len: 111 microversion: 2.1 time: 0.032845 Jun 16 17:36:24.318900 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 541/1083] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:24 2022] GET /compute/v2.1/servers/ba6cc107-9e30-4e1b-a561-5f3871c8998f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:36:24.370956 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c93d95c2-c2b3-4dc2-b381-c52d3e506789 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-182940941", "imageRef": "c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1", "flavorRef": "452", "networks": [{"uuid": "f24358e4-fd71-43f9-a3b7-69d150f32c61"}]}} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:24.425100 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.network.neutron [None req-c93d95c2-c2b3-4dc2-b381-c52d3e506789 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] validate_networks() for [('f24358e4-fd71-43f9-a3b7-69d150f32c61', None, None, None, None, None)] {{(pid=117553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:36:25.042174 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-c93d95c2-c2b3-4dc2-b381-c52d3e506789 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Flavor limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:36:25.042670 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-c93d95c2-c2b3-4dc2-b381-c52d3e506789 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Image limits 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:36:25.043310 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-c93d95c2-c2b3-4dc2-b381-c52d3e506789 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Flavor pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:36:25.043851 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-c93d95c2-c2b3-4dc2-b381-c52d3e506789 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Image pref 0:0:0 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:36:25.044480 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.virt.hardware [None req-c93d95c2-c2b3-4dc2-b381-c52d3e506789 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:36:25.058559 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c93d95c2-c2b3-4dc2-b381-c52d3e506789 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:25.059046 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c93d95c2-c2b3-4dc2-b381-c52d3e506789 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:25.059921 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c93d95c2-c2b3-4dc2-b381-c52d3e506789 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:25.060440 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c93d95c2-c2b3-4dc2-b381-c52d3e506789 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:25.078046 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-c93d95c2-c2b3-4dc2-b381-c52d3e506789 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Getting quotas for project 09d39fa8db0747f9b8237807b2735d5c. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:36:25.082484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.quota [None req-c93d95c2-c2b3-4dc2-b381-c52d3e506789 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Getting quotas for user 6833efa3f23d44a6b10d6b82e0b2b38c and project 09d39fa8db0747f9b8237807b2735d5c. Resources: {'cores', 'instances', 'ram'} {{(pid=117553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:36:25.096224 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c93d95c2-c2b3-4dc2-b381-c52d3e506789 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Going to run 1 instances... {{(pid=117553) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:36:25.098456 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c93d95c2-c2b3-4dc2-b381-c52d3e506789 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: 9a8be538-5b41-4c93-9b7b-3ed79908ee6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4c8be6c-aacc-4baa-a9d6-da0a900ccdf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:36:25.153818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c93d95c2-c2b3-4dc2-b381-c52d3e506789 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789056 Jun 16 17:36:25.154699 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 543/1084] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Jun 16 17:36:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:36:25.164300 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-c82cd70e-96a8-4f15-817c-e9a96187d1bb tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:25.164907 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-c82cd70e-96a8-4f15-817c-e9a96187d1bb tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: 9a8be538-5b41-4c93-9b7b-3ed79908ee6e] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:25.220423 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-c82cd70e-96a8-4f15-817c-e9a96187d1bb tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:25.227247 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-c82cd70e-96a8-4f15-817c-e9a96187d1bb tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e" status: 200 len: 1213 microversion: 2.1 time: 0.066861 Jun 16 17:36:25.228029 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 542/1085] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:25 2022] GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:26.245484 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-7079ea8a-da8e-44fb-a74a-20a073a8e98e tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:26.246182 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-7079ea8a-da8e-44fb-a74a-20a073a8e98e tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: 9a8be538-5b41-4c93-9b7b-3ed79908ee6e] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:26.254184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7079ea8a-da8e-44fb-a74a-20a073a8e98e tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:26.254627 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7079ea8a-da8e-44fb-a74a-20a073a8e98e tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:26.255397 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7079ea8a-da8e-44fb-a74a-20a073a8e98e tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:26.255824 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-7079ea8a-da8e-44fb-a74a-20a073a8e98e tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:26.327218 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-7079ea8a-da8e-44fb-a74a-20a073a8e98e tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:26.334820 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-7079ea8a-da8e-44fb-a74a-20a073a8e98e tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e" status: 200 len: 1271 microversion: 2.1 time: 0.094716 Jun 16 17:36:26.335382 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 544/1086] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:26 2022] GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:27.354056 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-5fa34fca-8b17-488b-9d9b-01f176bd90ef tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:27.355197 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-5fa34fca-8b17-488b-9d9b-01f176bd90ef tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: 9a8be538-5b41-4c93-9b7b-3ed79908ee6e] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:27.367724 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5fa34fca-8b17-488b-9d9b-01f176bd90ef tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:27.368509 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5fa34fca-8b17-488b-9d9b-01f176bd90ef tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:27.369897 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5fa34fca-8b17-488b-9d9b-01f176bd90ef tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:27.370770 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-5fa34fca-8b17-488b-9d9b-01f176bd90ef tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:27.478712 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [req-40fa3760-ecd6-42b4-acba-0404e5284db3 req-40e54bd3-1c9f-49a2-9e52-c7cfde545d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a8be538-5b41-4c93-9b7b-3ed79908ee6e", "tag": "ce07cf95-c9f7-4b66-9b41-344baf67f864"}]} {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:27.493676 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-40fa3760-ecd6-42b4-acba-0404e5284db3 req-40e54bd3-1c9f-49a2-9e52-c7cfde545d96 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:27.494116 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [req-40fa3760-ecd6-42b4-acba-0404e5284db3 req-40e54bd3-1c9f-49a2-9e52-c7cfde545d96 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:27.507745 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.compute.server_external_events [req-40fa3760-ecd6-42b4-acba-0404e5284db3 req-40e54bd3-1c9f-49a2-9e52-c7cfde545d96 service nova] Creating event network-changed:ce07cf95-c9f7-4b66-9b41-344baf67f864 for instance 9a8be538-5b41-4c93-9b7b-3ed79908ee6e on hv-cinder-83735 Jun 16 17:36:27.513213 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [req-40fa3760-ecd6-42b4-acba-0404e5284db3 req-40e54bd3-1c9f-49a2-9e52-c7cfde545d96 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038973 Jun 16 17:36:27.513809 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 545/1087] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:27.594759 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-5fa34fca-8b17-488b-9d9b-01f176bd90ef tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:27.602555 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-5fa34fca-8b17-488b-9d9b-01f176bd90ef tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e" status: 200 len: 1313 microversion: 2.1 time: 0.254390 Jun 16 17:36:27.603118 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 543/1088] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:27 2022] GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:28.623479 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-aab87885-58c0-49ff-907b-24c9825f421a tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:28.624162 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-aab87885-58c0-49ff-907b-24c9825f421a tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: 9a8be538-5b41-4c93-9b7b-3ed79908ee6e] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:28.630928 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-aab87885-58c0-49ff-907b-24c9825f421a tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:28.631366 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-aab87885-58c0-49ff-907b-24c9825f421a tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:28.632113 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-aab87885-58c0-49ff-907b-24c9825f421a tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:28.632538 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-aab87885-58c0-49ff-907b-24c9825f421a tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:28.780236 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-aab87885-58c0-49ff-907b-24c9825f421a tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:28.788242 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-aab87885-58c0-49ff-907b-24c9825f421a tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e" status: 200 len: 1313 microversion: 2.1 time: 0.170543 Jun 16 17:36:28.788784 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 546/1089] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:28 2022] GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:29.808202 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-12f977b6-3742-419c-8f89-ba013140fede tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:29.808961 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-12f977b6-3742-419c-8f89-ba013140fede tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: 9a8be538-5b41-4c93-9b7b-3ed79908ee6e] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:29.818631 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-12f977b6-3742-419c-8f89-ba013140fede tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:29.819260 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-12f977b6-3742-419c-8f89-ba013140fede tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:29.820375 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-12f977b6-3742-419c-8f89-ba013140fede tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:29.820980 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-12f977b6-3742-419c-8f89-ba013140fede tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:29.982761 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-12f977b6-3742-419c-8f89-ba013140fede tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:29.991076 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-12f977b6-3742-419c-8f89-ba013140fede tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e" status: 200 len: 1313 microversion: 2.1 time: 0.188643 Jun 16 17:36:29.991635 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 544/1090] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:29 2022] GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:31.008215 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8195432c-dbed-4a9f-b096-9038b99921e1 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:31.008830 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-8195432c-dbed-4a9f-b096-9038b99921e1 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: 9a8be538-5b41-4c93-9b7b-3ed79908ee6e] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:31.016040 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8195432c-dbed-4a9f-b096-9038b99921e1 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:31.016476 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8195432c-dbed-4a9f-b096-9038b99921e1 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:31.017372 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8195432c-dbed-4a9f-b096-9038b99921e1 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:31.017677 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8195432c-dbed-4a9f-b096-9038b99921e1 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:31.160431 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-8195432c-dbed-4a9f-b096-9038b99921e1 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:31.167904 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8195432c-dbed-4a9f-b096-9038b99921e1 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e" status: 200 len: 1313 microversion: 2.1 time: 0.163642 Jun 16 17:36:31.168466 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 547/1091] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:31 2022] GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:32.187105 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-b43e5685-d362-47ca-b54f-bcd9b751d32d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:32.187958 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-b43e5685-d362-47ca-b54f-bcd9b751d32d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: 9a8be538-5b41-4c93-9b7b-3ed79908ee6e] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:32.196582 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b43e5685-d362-47ca-b54f-bcd9b751d32d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:32.197219 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b43e5685-d362-47ca-b54f-bcd9b751d32d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:32.198522 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b43e5685-d362-47ca-b54f-bcd9b751d32d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:32.198873 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-b43e5685-d362-47ca-b54f-bcd9b751d32d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:32.348185 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-b43e5685-d362-47ca-b54f-bcd9b751d32d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:32.359989 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-b43e5685-d362-47ca-b54f-bcd9b751d32d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e" status: 200 len: 1313 microversion: 2.1 time: 0.177666 Jun 16 17:36:32.360739 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 545/1092] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:32 2022] GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:33.380559 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-835902ff-ee5d-44cc-9e72-66972d011bfc tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:33.381159 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-835902ff-ee5d-44cc-9e72-66972d011bfc tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: 9a8be538-5b41-4c93-9b7b-3ed79908ee6e] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:33.389409 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-835902ff-ee5d-44cc-9e72-66972d011bfc tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:33.389409 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-835902ff-ee5d-44cc-9e72-66972d011bfc tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:33.389900 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-835902ff-ee5d-44cc-9e72-66972d011bfc tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:33.390299 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-835902ff-ee5d-44cc-9e72-66972d011bfc tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:33.398205 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-7933127a-5480-407c-8c43-77bd747b6575 req-46706e82-9bf0-4e42-b6c9-3934c7725ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8be538-5b41-4c93-9b7b-3ed79908ee6e", "name": "network-vif-plugged", "status": "completed", "tag": "ce07cf95-c9f7-4b66-9b41-344baf67f864"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:33.413674 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-7933127a-5480-407c-8c43-77bd747b6575 req-46706e82-9bf0-4e42-b6c9-3934c7725ce5 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:33.414506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-7933127a-5480-407c-8c43-77bd747b6575 req-46706e82-9bf0-4e42-b6c9-3934c7725ce5 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:33.429862 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-7933127a-5480-407c-8c43-77bd747b6575 req-46706e82-9bf0-4e42-b6c9-3934c7725ce5 service nova] Creating event network-vif-plugged:ce07cf95-c9f7-4b66-9b41-344baf67f864 for instance 9a8be538-5b41-4c93-9b7b-3ed79908ee6e on hv-cinder-83735 Jun 16 17:36:33.449035 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-7933127a-5480-407c-8c43-77bd747b6575 req-46706e82-9bf0-4e42-b6c9-3934c7725ce5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056170 Jun 16 17:36:33.450049 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 546/1093] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:33.561007 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-835902ff-ee5d-44cc-9e72-66972d011bfc tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:33.569788 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-835902ff-ee5d-44cc-9e72-66972d011bfc tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e" status: 200 len: 1313 microversion: 2.1 time: 0.193537 Jun 16 17:36:33.570383 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 548/1094] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:33 2022] GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:34.588952 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-2e75ab61-a1e6-4480-9b64-f48f6be1b7ba tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:34.590497 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-2e75ab61-a1e6-4480-9b64-f48f6be1b7ba tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: 9a8be538-5b41-4c93-9b7b-3ed79908ee6e] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:34.597420 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2e75ab61-a1e6-4480-9b64-f48f6be1b7ba tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:34.597788 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2e75ab61-a1e6-4480-9b64-f48f6be1b7ba tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:34.598541 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2e75ab61-a1e6-4480-9b64-f48f6be1b7ba tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:34.598968 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2e75ab61-a1e6-4480-9b64-f48f6be1b7ba tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:34.745778 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-2e75ab61-a1e6-4480-9b64-f48f6be1b7ba tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:34.753833 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-2e75ab61-a1e6-4480-9b64-f48f6be1b7ba tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e" status: 200 len: 1313 microversion: 2.1 time: 0.169660 Jun 16 17:36:34.754400 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 547/1095] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:34 2022] GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:35.771600 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-da40b035-7b1d-47be-85e8-a8cf8fe7f28d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:35.772178 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-da40b035-7b1d-47be-85e8-a8cf8fe7f28d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: 9a8be538-5b41-4c93-9b7b-3ed79908ee6e] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:35.774347 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=2 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:35.775025 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell0:SELECT=6 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:35.781824 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-da40b035-7b1d-47be-85e8-a8cf8fe7f28d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:35.782184 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-da40b035-7b1d-47be-85e8-a8cf8fe7f28d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:35.783026 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-da40b035-7b1d-47be-85e8-a8cf8fe7f28d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:35.783435 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-da40b035-7b1d-47be-85e8-a8cf8fe7f28d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:35.919423 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-da40b035-7b1d-47be-85e8-a8cf8fe7f28d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:35.928168 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-da40b035-7b1d-47be-85e8-a8cf8fe7f28d tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e" status: 200 len: 1498 microversion: 2.1 time: 0.159738 Jun 16 17:36:35.928168 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 549/1096] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:35 2022] GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:36.395009 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-2feaf666-fc09-42f4-963b-9287797d2f8c tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:36.395813 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-2feaf666-fc09-42f4-963b-9287797d2f8c tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: 9a8be538-5b41-4c93-9b7b-3ed79908ee6e] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:36.397620 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell0:SELECT=2 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:36.404877 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2feaf666-fc09-42f4-963b-9287797d2f8c tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:36.405280 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2feaf666-fc09-42f4-963b-9287797d2f8c tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:36.406099 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2feaf666-fc09-42f4-963b-9287797d2f8c tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:36.406506 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-2feaf666-fc09-42f4-963b-9287797d2f8c tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:36.434817 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-2feaf666-fc09-42f4-963b-9287797d2f8c tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: 9a8be538-5b41-4c93-9b7b-3ed79908ee6e] Going to try to terminate instance {{(pid=117552) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:36:36.518999 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-2feaf666-fc09-42f4-963b-9287797d2f8c tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e" status: 204 len: 0 microversion: 2.1 time: 0.127955 Jun 16 17:36:36.519772 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 548/1097] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Jun 16 17:36:36 2022] DELETE /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:36:36.527905 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-c2515e40-97c5-4566-b7b3-f9a64d2e20ff tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:36.528501 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-c2515e40-97c5-4566-b7b3-f9a64d2e20ff tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: 9a8be538-5b41-4c93-9b7b-3ed79908ee6e] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:36.535329 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c2515e40-97c5-4566-b7b3-f9a64d2e20ff tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:36.535770 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c2515e40-97c5-4566-b7b3-f9a64d2e20ff tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:36.536533 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c2515e40-97c5-4566-b7b3-f9a64d2e20ff tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:36.536961 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-c2515e40-97c5-4566-b7b3-f9a64d2e20ff tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:36.685586 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-c2515e40-97c5-4566-b7b3-f9a64d2e20ff tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:36.689949 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:36.696360 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-c2515e40-97c5-4566-b7b3-f9a64d2e20ff tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e" status: 200 len: 1504 microversion: 2.1 time: 0.172206 Jun 16 17:36:36.697150 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 550/1098] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:36 2022] GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:37.720613 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [None req-07617acd-5978-4e76-b882-aec9c0bf9810 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:37.721338 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.compute.api [None req-07617acd-5978-4e76-b882-aec9c0bf9810 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: 9a8be538-5b41-4c93-9b7b-3ed79908ee6e] Fetching instance by UUID {{(pid=117552) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:37.728246 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-07617acd-5978-4e76-b882-aec9c0bf9810 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:37.728687 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-07617acd-5978-4e76-b882-aec9c0bf9810 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:37.729538 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-07617acd-5978-4e76-b882-aec9c0bf9810 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:37.730155 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [None req-07617acd-5978-4e76-b882-aec9c0bf9810 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:37.864692 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.policy [None req-07617acd-5978-4e76-b882-aec9c0bf9810 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117552) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:37.872672 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [None req-07617acd-5978-4e76-b882-aec9c0bf9810 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e" status: 200 len: 1504 microversion: 2.1 time: 0.156366 Jun 16 17:36:37.873490 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 549/1099] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:37 2022] GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:38.890368 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-a6b73f1a-2fed-45a2-9505-afc0a17a0b12 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:38.891130 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-a6b73f1a-2fed-45a2-9505-afc0a17a0b12 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: 9a8be538-5b41-4c93-9b7b-3ed79908ee6e] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:38.893498 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG dbcounter [-] [117553] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:38.899962 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a6b73f1a-2fed-45a2-9505-afc0a17a0b12 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:38.900410 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a6b73f1a-2fed-45a2-9505-afc0a17a0b12 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:38.901277 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a6b73f1a-2fed-45a2-9505-afc0a17a0b12 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:38.901918 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-a6b73f1a-2fed-45a2-9505-afc0a17a0b12 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:38.971364 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.policy [None req-a6b73f1a-2fed-45a2-9505-afc0a17a0b12 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6833efa3f23d44a6b10d6b82e0b2b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d39fa8db0747f9b8237807b2735d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117553) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:38.979206 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-a6b73f1a-2fed-45a2-9505-afc0a17a0b12 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e" status: 200 len: 1462 microversion: 2.1 time: 0.093272 Jun 16 17:36:38.980082 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 551/1100] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:38 2022] GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e => generated 1462 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:38.992515 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG nova.api.openstack.wsgi [req-8cead341-fbea-41ac-8c40-9c74ab57946f req-38362055-d03d-4f7d-b60c-989728a51f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8be538-5b41-4c93-9b7b-3ed79908ee6e", "name": "network-vif-deleted", "tag": "ce07cf95-c9f7-4b66-9b41-344baf67f864"}]} {{(pid=117552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:38.996976 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:39.003471 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-8cead341-fbea-41ac-8c40-9c74ab57946f req-38362055-d03d-4f7d-b60c-989728a51f91 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:39.003912 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG oslo_concurrency.lockutils [req-8cead341-fbea-41ac-8c40-9c74ab57946f req-38362055-d03d-4f7d-b60c-989728a51f91 service nova] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:39.006950 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: DEBUG dbcounter [-] [117552] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:39.016990 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.compute.server_external_events [req-8cead341-fbea-41ac-8c40-9c74ab57946f req-38362055-d03d-4f7d-b60c-989728a51f91 service nova] Creating event network-vif-deleted:ce07cf95-c9f7-4b66-9b41-344baf67f864 for instance 9a8be538-5b41-4c93-9b7b-3ed79908ee6e on hv-cinder-83735 Jun 16 17:36:39.022024 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO nova.api.openstack.requestlog [req-8cead341-fbea-41ac-8c40-9c74ab57946f req-38362055-d03d-4f7d-b60c-989728a51f91 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033439 Jun 16 17:36:39.022639 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: [pid: 117552|app: 0|req: 550/1101] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jun 16 17:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:36:39.996319 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8c9dc8e9-c089-4a4e-8025-ca7954a90ef4 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Calling method '>' {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:39.996918 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.compute.api [None req-8c9dc8e9-c089-4a4e-8025-ca7954a90ef4 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] [instance: 9a8be538-5b41-4c93-9b7b-3ed79908ee6e] Fetching instance by UUID {{(pid=117553) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:40.003920 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8c9dc8e9-c089-4a4e-8025-ca7954a90ef4 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:40.004358 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8c9dc8e9-c089-4a4e-8025-ca7954a90ef4 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:40.005105 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8c9dc8e9-c089-4a4e-8025-ca7954a90ef4 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:40.005563 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG oslo_concurrency.lockutils [None req-8c9dc8e9-c089-4a4e-8025-ca7954a90ef4 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Lock "bda7c23a-ff4f-46ad-9b00-aa25962dbf72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:40.019333 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.wsgi [None req-8c9dc8e9-c089-4a4e-8025-ca7954a90ef4 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] HTTP exception thrown: Instance 9a8be538-5b41-4c93-9b7b-3ed79908ee6e could not be found. Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8c9dc8e9-c089-4a4e-8025-ca7954a90ef4 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Request method failure captured: Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: request: GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e HTTP/1.1 Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept: application/json Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Accept-Encoding: identity Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Connection: close Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Length: 0 Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Content-Type: application/json Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Host: 10.222.0.66 Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Openstack-System-Scope: None Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: User-Agent: python-urllib3/1.26.9 Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Auth-Token: gAAAAABiq2oGyQsjf2doveewAClVmX_XwmSy2Jfy_Q6JrLpv048SGZ2jWdccw9xmb_5Rtm0toLaMiNcdMnXIIntqbo5o-qAbmyoam2F57CHy-sF6H__55FqzcCr_C5O2rH2OBcA5iEJAYKpTqVJ7ozsZXpVIpiJDG276Pzl_UI9SHfT_ZHwsAk8 Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Id: None Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Domain-Name: None Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Identity-Status: Confirmed Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Is-Admin-Project: True Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Id: default Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Domain-Name: Default Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Id: 09d39fa8db0747f9b8237807b2735d5c Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Project-Name: tempest-VolumesActionsTest-934369678 Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Role: reader,member Jun 16 17:36:40.020987 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Roles: reader,member Jun 16 17:36:40.022765 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/09d39fa8db0747f9b8237807b2735d5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/09d39fa8db0747f9b8237807b2735d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_09d39fa8db0747f9b8237807b2735d5c", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/09d39fa8db0747f9b8237807b2735d5c"}]}] Jun 16 17:36:40.022765 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant: tempest-VolumesActionsTest-934369678 Jun 16 17:36:40.022765 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Id: 09d39fa8db0747f9b8237807b2735d5c Jun 16 17:36:40.022765 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-Tenant-Name: tempest-VolumesActionsTest-934369678 Jun 16 17:36:40.022765 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User: tempest-VolumesActionsTest-934369678-project Jun 16 17:36:40.022765 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Id: default Jun 16 17:36:40.022765 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Domain-Name: Default Jun 16 17:36:40.022765 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Id: 6833efa3f23d44a6b10d6b82e0b2b38c Jun 16 17:36:40.022765 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: X-User-Name: tempest-VolumesActionsTest-934369678-project Jun 16 17:36:40.022765 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: method: > Jun 16 17:36:40.022765 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: exception: Instance 9a8be538-5b41-4c93-9b7b-3ed79908ee6e could not be found. Jun 16 17:36:40.022765 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: action_args: {'id': '9a8be538-5b41-4c93-9b7b-3ed79908ee6e'} Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: {{(pid=117553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a8be538-5b41-4c93-9b7b-3ed79908ee6e could not be found. Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:36:40.023780 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a8be538-5b41-4c93-9b7b-3ed79908ee6e could not be found. Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a8be538-5b41-4c93-9b7b-3ed79908ee6e could not be found. Jun 16 17:36:40.025504 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: ERROR nova.api.openstack.wsgi Jun 16 17:36:40.027148 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: DEBUG nova.api.openstack.wsgi [None req-8c9dc8e9-c089-4a4e-8025-ca7954a90ef4 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] Returning 404 to user: Instance 9a8be538-5b41-4c93-9b7b-3ed79908ee6e could not be found. {{(pid=117553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:36:40.027148 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO nova.api.openstack.requestlog [None req-8c9dc8e9-c089-4a4e-8025-ca7954a90ef4 tempest-VolumesActionsTest-934369678 tempest-VolumesActionsTest-934369678-project] 10.222.0.66 "GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e" status: 404 len: 111 microversion: 2.1 time: 0.030471 Jun 16 17:36:40.027148 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: [pid: 117553|app: 0|req: 552/1102] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:39 2022] GET /compute/v2.1/servers/9a8be538-5b41-4c93-9b7b-3ed79908ee6e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:37:42.827413 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:37:42.828036 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Thu Jun 16 17:37:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:39:22.549254 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:39:22.549818 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Thu Jun 16 17:39:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:39:23.842290 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:39:23.842988 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Thu Jun 16 17:39:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:39:43.491813 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:39:43.493070 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Thu Jun 16 17:39:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:39:46.481954 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:39:46.482523 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Thu Jun 16 17:39:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:41:02.837116 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:41:02.837116 dv-cinder-837356-2-iscsi devstack@n-api.service[117552]: Thu Jun 16 17:41:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:41:03.601576 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:41:03.602380 dv-cinder-837356-2-iscsi devstack@n-api.service[117553]: Thu Jun 16 17:41:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!